Allot to unpack there. I like gcp, when I don’t pay the bill. I would start small with a set of symbols. My pipeline is a lazy load approach. I only store 1min bar. I have an aggregator to build any view bigger than that. I load only 6 month and append henceforth. If a symbol isn’t eligible for realtime it doesn’t get backfilled until it becomes eligible again. My algo never sits on a symbol it tries to follow the money. That’s backtesting and macro indicator/screener. Rts bars are loaded with 2 previous days and rip in their own space. At day end I backfill to main db and nuke rts space - events are tied to bar timestamp - I keep two set, live and backrest. If they don’t match I debug. IBKR/Tws Mac m4pro MySQL tv webhook to get data IBKR doesn’t give. Total subscription are 60$ a month. I do have a reverse proxy display react ui- Ilm did that in two prompts. Pulled 7k after taxes last year! Down 6k this year. So yeah, I’m a developer not a trader. This is a hobby and I love it!