It's not a real-life tree; it's been invented for the game.
When you talk to Frederic, he mentions that the tree grows in the swamp.
You don't need to dig to find the family key, you just need to find a way underground beneath an area where fruitful plants grow. Make sure you're wearing the necklace Kayanna gave you, too.