Hey dont feel bad, man. I thought the same exact thing when me and my buddy got to the creek (which connects to the lake, its away from the "designated camp area") but the place was PACKED. Sorry you couldn't enjoy the area because it truely is beautiful. Don't mark this place off your list just yet, try to get here when there's not so many tourists (holiday weekend). Towards the back of the lake where it connects to a creek it is very, very beautiful, canyons and caves galore.
Take care