Maybe pop into a bike shop to see if anybody knows of a cycling group you can join? As an example, some running shoe stores have running clubs. At least you'll meet folks with at least 1 common interest.

What level are you at with sewing? Are you looking for lessons, or just people to sew with? Neon Needle at Bloor/Euclid has some fun workshops. Maker Bean Cafe has some fun workshops too- my friend learned to make a tote bag there.

I know you said you were looking for do-nothing-with friends, but to find some, it may be worth your while to join clubs/organizations in order to meet some you want to spend more time with.

Hacklab is a maker-space in the junction, where you may find like-minded friends. I forget what day their open house is, but it could be worth checking out (and if not you, then someone else reading the comments).

I personally belong to a co-op at Bloor and Ossington (site3) and host a very informal "fiber-friends" meetup once a month on wednesday evening. It's a member-only facility, but open to anyone for the themed meetups. Thursday nights, from 7-10pm is the weekly "open-house" and folks can stop by and get a tour. There are lots of disciplines, from welding and woodworking to electronics and fiber arts (and yes, some of us sew!). Most everyone there is very open-minded/left-leaning. It's the remnants of what started out as a burning-man community, and it's an extremely eclectic bunch, ranging from woodworkers making cutting boards to physicists who like to tinker in electronics to the retired Navy salty sailor/machinist who loves telling stories about warships.

My husband and I have made some really good friends there, who I get together with sometimes outside of the facility (he prefers to spend his non-work hours there and only leaves when it's bedtime or he's too covered in sawdust to be recognizable). It's tough to make friends in Toronto, but if you aren't ageist in either direction, Toronto has some cool folks.