From what I would know is you have to have a model to do it. I have tried to do a similar thing with a globe.
Ends up that displacements isnt a perfect sphere.
You could try making a globe, Hollowing it only for a reference and then manually create each brush as a wall, I tried that but it gave me errors when I opened it.