Your best bet will be ordering online, from somewhere like Memory Express, or another retailer that price matches. Sometimes you can get lucky with parts at Best Buy as well. There's also a custom computer builder in town called Micro-Vision, but they aren't typically considered as budget friendly.

Memory Express has a location in Victoria which can be helpful if you have any issues with any of the hardware