About 8km southwest of the town (past the turn-off to Saraswati Temple) is a collection of Shiva temples near Ajaypal, which make a great trip by motorbike (or bike if you’re fit and start early in the day), through barren hills and quiet villages. Be warned: the track is hilly and rocky.
Another Shiva temple is about 8km north of Pushkar, tucked down inside a cave, which would make for a good excursion.