After living in Victoria for several years, we came across the Abkhazi Gardens after driving by their sign post. We had no idea it existed!
It's a lovely garden near the city centre where you can have afternoon tea and enjoy the beautiful setting. In fact, I liked it so much that we had our wedding ceremony and reception there recently. We had over 70 guests and they couldn't stop raving at how beautiful the gardens were and the food/service was top notch.
It's worth a stop and the entry fee is by donation.