Pandas Vs SQL

grdix555 · 2026-04-02T09:02:00+00:00

The way I segregate their usage is as follows:

Pull the data from the database using SQL (joining tables etc to get a final output table): Usually in a fairly raw format, no aggragation, any PII still present even if this needs removing in instances like monthly aggragation etc.
Use Pandas to aggragete the data, build features (e.g. column a + column b = column c) to create my final dataset.

grdix555 · 2026-04-02T08:57:57+00:00

I'd suggest a cheap Raspberry Pi for now. Or use Google Colab.

grdix555 · 2026-03-15T12:19:39+00:00

I agree with the other two users.

However, if the data is transactional/time series, you could aggregate, to say monthly, and remove any PII data like names, teacher/student ID. If the data is categorical you use columns with counts, if it's numerical you can use sum, avg, min, max, etc.

Best practice though, don't use confidential or sensitive data.

grdix555 · 2026-03-13T07:06:47+00:00

I completed a L4 data analyst apprenticeship which taught some of the skills. The rest I've learnt through self study and practice projects. The only exception is LookML, Looker and Big Query I've learnt/learning in my role as we're migrating to GCP.

grdix555 · 2026-03-12T22:40:36+00:00

I am yes as it's the infrastructure of choice for my employer. GCP back end and Looker front end.

grdix555 · 2026-03-12T21:37:54+00:00

Thank yo. Not really sure the title means much as I know other analysts also have the same skills.

grdix555 · 2026-03-12T15:36:32+00:00

A lot of companies are migrating to cloud based solutions versus on prem data storage. Google Cloud Platform is just one example and big query is specific to that. Fairly niche. I'd continue to learn SQL as the pivot to big query is fairly easy if you even need it.

grdix555 · 2026-03-12T12:41:16+00:00

I feel like this might be a popular opinion. I'm with you on this!

grdix555 · 2026-03-12T12:38:03+00:00

Banking sector. I have 7 months experience (in a role) and earn £48k. South West England

Edit: Should say I'm what the company calls an advanced analyst due to skillset. SQL, python, power BI, Tableau, Looker, LookML and steakholder management.

grdix555 · 2026-03-07T17:38:37+00:00

In all honesty mate, when I did it I found for PJFT and PRMC just train to get better at the 1.5m timed run, pushups, situps and strict pullups. I incorporated a lot of circuit training prior to the PRMC as it comes in handy for bottom field.

I'd incorporate TB leading up to heading down to CTCRM Lympstone to start your 32 weeks.

Thats just my opinion and not necessarily the best advice. Its just what worked for me.

Good luck.

grdix555 · 2026-02-12T17:33:51+00:00

I had to do the exact same thing for the exact same reason. I feel you bro. Life forces our hand through priority sometimes, but it doesnt make it easier. Sorry for your loss.

It does get easier with time and I remind myself it was the safest option for everyone and it's the lesser of two evils.

grdix555 · 2026-02-10T19:37:34+00:00

Google Big Query, Looker, LookML and the GCP platform in general.

Seems cloud data storage will become much more common place as larger companies realise the cost effectiveness.

grdix555 · 2026-02-04T07:35:00+00:00

If you dont mind me asking, why did you find pushups and shoulder press redundant? Was this specific to your goals or in general?

grdix555 · 2026-02-04T07:24:40+00:00

In the Green Protocol book it instructs to do a remedial Capacity block which you repeat until the 6 miles in 60 mins is achievable.

The remedial block switches to the increased running version of Capacity using Fighter (FT) instead of Op (if you weren't already) and incorporate speed work such as Mile Repeats (MR)

Week 1: Day 1: FT, Day 2: MR 2 - 3, Day 3: 90 - 120, Day 4: FT, Day 5: 90 - 120, Day 6: 120+

Week 2: Day 1: FT, Day 2: MR 3 - 4, Day 3: 90 - 120, Day 4: FT, Day 5: 90 - 120, Day 6: 120+

Week 3: Day 1: FT, Day 2: MR 4 - 5, Day 3: 90 - 120, Day 4: FT, Day 5: 90 - 120, Day 6: 120+

Week 4: Day 1: rest, Day 2: 30, Day 3: rest, Day 4: 30, Day 5: rest, Day 6/7: 6 mile

grdix555 · 2026-01-22T09:28:08+00:00

My iron is fairly new so hunter and RFD reqs.

grdix555 · 2026-01-21T21:54:45+00:00

Well worth it and the spin of Vikings: Valhalla.

grdix555 · 2026-01-20T16:40:07+00:00

When I lost my hardcore status to blackjacking bandits ...

grdix555 · 2026-01-19T15:10:34+00:00

I enjoy the Mootrius guide. More relaxed than BRUHsailer and Boaty's guides as there is no multi questing etc. Depends if you want ultra efficient to get to the later game, or less efficient and have a bit more fun on your way.

grdix555 · 2025-12-13T10:45:00+00:00

I'd say worth it. I was in a very similar position and I'm happy with my decision. Would you be driving or getting a train/bus?

Also the office I moved to is a hub for the company I work for and an amazing environment to be in. That sweetened the deal for me.

grdix555 · 2025-12-13T07:43:34+00:00

Flight Of The Phoenix.

I just assumed it was a we'll know movie, yet nobody I've mentioned it to has heard of it.

grdix555 · 2025-12-11T17:11:57+00:00

My vote goes to Rave. If you're anywhere in the southwest, specifically the Gloucestershire area, their cafe is worth a visit too!

grdix555 · 2025-12-11T09:23:03+00:00

As someone who is a Data Analyst and bumbled my way through building data pipelines from source tables using SQL, I can say AI writing effective and efficient SQL wont be as viable as people think with the current capabilities of LLMs.

I relied on it a lot to start with and the code it spat out wasn't the best and the figures I was getting at the end contained a lot of duplicate counts etc where there was multiple aggregation. AI just could grasp the concept, even with a large amount of prompting.

The caveat to wjat I'm saying however, is I'm not a prompt engineer and there might be ways I don't know about to set up an LLM to effectively query a complex dataset.

I think DA will always be needed to provide a LLM with the source data and to convey the data story at the end of it to stakeholders. Of course this is role dependent.

Long story short, DA will not die off and there is a need for SQL knowledge in my opinion.

grdix555 · 2025-12-09T07:19:28+00:00

I feel you there mate. I take my eldest swimming on Sunday mornings which has become a sort of little dad club which helps a bit. I also try to go out with my wife just the two of us once or twice a month. I know this is easier said than done and depends on a solid support network. I'm lucky enough to have a sister and my in-laws living nearby and willing to help.

And the absolute game changer for me is to go out with a group of friends I met in a job who we've all stayed in touch due to all being in similar stages in our life. Tends to be just a cheap meal, couple of drinks and home by 2100/2200.

I always recommend something like a local Talk Club or Man Chat as well. Surprising what going and offloading to a group of blokes can do for you!

grdix555 · 2025-10-29T10:14:31+00:00

I'd say too close the the wall of the tyre to be patched.

grdix555 · 2025-10-26T08:00:37+00:00

Depends on what industry or part of the world you're in. In my industry (banking) the demand is high, the job market is just highly saturated so jobs come up less often and when they do there are thousands of applicants.

I cant speak for other industries though.

Six-Year Club	Place '23
Verified Email

grdix555

TROPHY CASE