I personally love this park, but I like to backpack and use the primitive sites. The park is quite rustic and primitive, but absolutely worth seeing. There are MANY little waterfalls and refreshing pools of jade green water, lots of wild life - the deer will almost walk up to you and armadillos are pretty common there too.
I haven't seen the caves yet, but I hear they are worth seeing. The Gorman Falls is gorgeous and a must see. We stayed in a camp site one night there. I think it was one of the walk-in sites, but it was a short walk from the car - just a little jaunt up the hill. The sites seemed fairly spread out too, so your neighbors aren't right on top of you. And one can always find a nice comfy spot in the woods (away from trails, food and water sources of course) accompanied with some trusty moon floss and take care of business - you don't have to use the compost potties if you don't wanna! (I have never had the pleasure of using one and plan on keeping it that way!)