The building is really interesting (albeit a bit controversial) and I would say far more attractive inside than outside. I didn't spend long here - it was a last minute idea when my mom was in town so we squeezed it in. Their furniture and Canadian history exhibits were lovely and I am sure there was more to discover in the endless museum.
The only downside: hefty admission price. My mom and I caught the Wednesday after 3:30pm free entrance so it was great for us but I am hesitant to cough up the admission + special exhibit fee. There is also a half price Friday afternoon special, so that may be worth it as well.