The park, located near Baker, Nevada, is a great place to hike, especially in the spring/early summer when the snow melt fills the lakes. The Lehman Caves are worth a visit if you don't have a problem being ~200' underground at points. Story goes Absalom Lehman was hunting in the area. A mouse stole his sandwich and he chased after it. He fell down the mountain a short way and found the entrance to the cave.
Pro Tip: Lehman Caves requires a reserved time and has a fee associated. Book on recreation.gov in advance to make sure you get in.