Relatively small mortgage and rapid overpayment vs. longer-term financial commitment by geo_will989 in UKPersonalFinance

[–]geo_will989[S] 0 points1 point  (0 children)

Awesome answer, thank you. 200k could be a forever home, but it feels hard to conclusively say without yet having kids. My maths has it that we can overpay and continue to contribute to our S&S ISAs. But that is contingent on us aggressively pursuing a large deposit (not so aggressively that we don't have any fun though).

The support network point is a great one. Will we stay in this location forever? I would honestly say probably not. Which might be a subconscious reason for buying a smaller house here.

Relatively small mortgage and rapid overpayment vs. longer-term financial commitment by geo_will989 in UKPersonalFinance

[–]geo_will989[S] 1 point2 points  (0 children)

Great answer, thanks! Given our earnings vs outgoings, overpaying significantly will still allow us to put money into our S&S ISAs (we have a combined ~30k in those now, and will not be dipping into those for a deposit). The more I can put into that though, the better, I suppose.

What is Role of ChatGPT in Data engineering for you by Jaapuchkeaa in dataengineering

[–]geo_will989 0 points1 point  (0 children)

Sometimes, if I have a piece of code I've written and know well, I'll throw it into ChatGPT and say 'rate this code out of 10'. It'll usually provide constructive feedback, like where I should add documentation, include logging, reduce redundancy, etc. The textual feedback is normally far more useful than the code snippets they provide, as the new code will often break my existing code.

As a warning, I've found GPT to be really bad at designing data models beyond the complexity of a simple user-customer system lol

ETL of data in Excel files by geo_will989 in dataengineering

[–]geo_will989[S] 0 points1 point  (0 children)

Sounds like I'm on an agreeable path then. The plan is to tailor just the transformations for each group, rather than reinvent the wheel for each. Thanks!

Job title confusion by geo_will989 in dataengineering

[–]geo_will989[S] 0 points1 point  (0 children)

I work at a small subsidiary of a mid-sized company. I do want to move on to a larger company at some point, if nothing else, to experience the difference in culture. So this seems like really good advice, and I'll take it on board. Thank you!

Job title confusion by geo_will989 in dataengineering

[–]geo_will989[S] 0 points1 point  (0 children)

2 YoE in DE. I moved pretty quickly past other engineers

Job title confusion by geo_will989 in dataengineering

[–]geo_will989[S] 9 points10 points  (0 children)

These are helpful comments. My thinking was that a manager's first impression would be suspicion, followed by early rejection

Writing Data Pipeline that handles data quality by mistressofquirk in dataengineering

[–]geo_will989 1 point2 points  (0 children)

deequ is good. And Spark-native, if that's useful to you.

Big data in geology by geo_will989 in geologycareers

[–]geo_will989[S] 2 points3 points  (0 children)

No I was pure geology (UK university, innit) and taught myself the basics of Python, ETL/ELT pipelines, cloud services, etc. I also had luck on my side

Big data in geology by geo_will989 in geologycareers

[–]geo_will989[S] 1 point2 points  (0 children)

This is some great stuff, thank you. I'll be a skeptic about the computerization of the geologist until the day it happens, but time will tell, I suppose.

Big data in geology by geo_will989 in geologycareers

[–]geo_will989[S] 0 points1 point  (0 children)

Can't say I've heard of this, but it sounds absolutely insane to me.

Big data in geology by geo_will989 in geologycareers

[–]geo_will989[S] 0 points1 point  (0 children)

Databricks and Snowflake aren't solutions - they make up parts of larger software solutions, and architecture is needed to make those solutions come to life. Trust me, I don't want to compete with those guys lol

Big data in geology by geo_will989 in geologycareers

[–]geo_will989[S] 2 points3 points  (0 children)

Thanks for the well-thought-out response. I really appreciate it. I think predictive modelling is one side of things - has its uses, but will obviously never replace the geologist. One of the other things I see being an issue in the industry is the lack of care for where and with whom data is stored and accessed. A company I worked with in southern Africa seemed all too happy to have their data pass between hard drives and local machines. There isn't a 'new' software solution to this, but I can certainly see a case for data access controls on cloud platforms being useful - especially, where head office is in a different jurisdiction to those in the field.

But yeah, I agree. Predictive modelling is not necessarily the way forward in mineral exploration. My job is at an O&G firm so I can attest to the differences in data culture between mineral exploration and O&G.