The official unofficial FAQ of CAVEMANforum
The restaurant itself is very paleoish. Of course they also serve potatoes and desserts, but their specialty is serving every part of the big, foie gras, duck and tartare. They prepare food in a way caveman would be proud. They are known internationally and you have to make reservations a few weeks in advance because foodies all around the place go there.
Good French cooking is often quite close to paleo.
I would venture to say most Ala Carte steakhouses (ruth's chris, etc) are already as paleo as possible while still catering to the rest of the world, and that's about the only way it would work. No paleo side-dishes really, but there is always the classic steak + salad.