You can easily get out there to have lunch, do some hiking, visit the Basilica, and observatory then return by dinner. The hill is easy to walk around with not too many steep steps or hills. There are several refreshment stands selling food and drinks. The trails are paved and easy. Worth doing on a good weather day.
Take metro line 9 to Sheshan station then go by taxi to the West Sheshan entrance.