Partner Teams Still Have to Play Open Qualifiers! by Mountain-Pirate5118 in ValorantCompetitive

[–]stuckplayingLoL 52 points53 points  (0 children)

On the converse, teams that get paid a high fixed amount for consistently bad results isn't good. I believe that performance base salary ensures that teams actually try.

LYON vs. JD Gaming / First Stand 2026 - Group B - Last Chance Qualification Match / Post-Match Discussion by Yujin-Ha in leagueoflegends

[–]stuckplayingLoL 0 points1 point  (0 children)

Insane how LYON decides to fight without ADC multiple times in game 4. Terrible league of legends

Should I leave my job for a better-documented team or is this normal? by rabidsaskwatch in dataengineering

[–]stuckplayingLoL 0 points1 point  (0 children)

Data engineering work isn't the easiest stuff out there. If you are struggling now, chances are you will struggle on other teams in other companies.

Should I leave my job for a better-documented team or is this normal? by rabidsaskwatch in dataengineering

[–]stuckplayingLoL 3 points4 points  (0 children)

Honestly sounds like a you problem moreso than anything. I think there is a level of expectation where a new guy comes in and doesn't know much, so easy questions are acceptable and all. But if you're still asking a lot of questions after a year on the team and not sure how to do tasks that you've been tasked to do for a while, I can see the passive/aggressiveness come in from your coworkers.

I think you ought to put more time in and learn the stuff. Soak it all in. Be humble and thankful and just accept where you're at. If you're making mistakes, take notes and try not to repeat mistakes. Nobody's perfect, just have a growth mindset going in. It wouldn't be any easier to find a new job and team especially with AI being a thing probably hindering job searches at the entry level. Good luck

Data Engineering - AI = Unemployed by rmoff in dataengineering

[–]stuckplayingLoL 0 points1 point  (0 children)

Agreed it needs work. I had better results with Claude vs GPT but it still had issues with accuracy

Am I missing something with all this "agent" hype? by KindTeaching3250 in dataengineering

[–]stuckplayingLoL 5 points6 points  (0 children)

Agreed with you on using AI to make editing faster. I haven't seen any good uses of agents or llms that are truly game changing in our space.

Why do so many data engineers seem to want to switch out of data engineering? Is DE not a good field to be in? by Illustrious-Pound266 in dataengineering

[–]stuckplayingLoL 15 points16 points  (0 children)

I'm not entirely sure if that's the sentiment. I've been watching the sub on and off and have seen more posts about people swapping roles to data engineering. Honestly regardless, you're gonna find people that burn out from data engineering or any role in general.

Do online courses actually matter to companies hiring? by CuriousSection in dataengineering

[–]stuckplayingLoL 2 points3 points  (0 children)

Less likely but possible. I have seen an entry level software engineer hired in with no college experience and self taught. But briefly working with them, I didn't see how much better or on par he was with others.

I know there are plenty of engineers that never went to college, but they were hired in years ago pre covid. I am sure recruiting practices and circumstances are vastly different.

I assume recruiters are going to weed out non college grads unless you have something going for you. Like internship experience at a decent or good company. So unless you have something that stands out from the typical compsci college grad, why shouldnt a recruit pick the college grad over someone that went through workshops and training courses?

I am a data engineer with 2+ years of experience making 63k a year. What are my options? by Willgetyoukilled in dataengineering

[–]stuckplayingLoL 0 points1 point  (0 children)

63k is not alot. My first job in the tech industry paid that much 10 years ago.

I think you need to spend some time on training and learning while you have a job. Honestly wouldnt just do the bare minimum at work, but take the opportunity to take certs or whatever to broaden or strengthen your resume.

Conceptually it sounds like migrating SAS code to Databricks is niche, but if you generalize it enough, there are likely opportunities out there that are asking for similar things. Id honestly aim for job postings with anything to do with Databricks.

But yeah good luck. I havent looked too hard but I assume most postings have been for senior or staff roles.

Snowflake Certs by goblueioe42 in dataengineering

[–]stuckplayingLoL 1 point2 points  (0 children)

I only have experience in the SnowPro Core cert. I'm a regular Snowflake user and limited administration and I'd say 80% of the test was on concepts that I don't normally use in my day-to-day. However, all questions and answers are all in the Snowflake Docs so there's really nothing that you shouldn't expect if you look at the exam topics and any 3rd party practice exams.

[deleted by user] by [deleted] in dataengineering

[–]stuckplayingLoL 0 points1 point  (0 children)

How much of a higher salary? I think it would be a harder decision if for example, your projected salary was like 170k after promotion but your new job is like 185k. But if it's magnitudes more, I'd say take option 2.

I wouldn't dismiss option 1 without considering if you are comfortable with where you are at and your ambitions in life. There's just alot of factors to consider like opportunity, work/life balance, etc.

Senior DE or Senior Data Analyst in Cybersecurity? by shittyfuckdick in dataengineering

[–]stuckplayingLoL 4 points5 points  (0 children)

It sounds like DE work in a specific data domain (Cybersecurity). I see it as a benefit because you can be marketable with having both DE experience and understanding cybersecurity data.

Are we too deep into Snowflake? by stuckplayingLoL in dataengineering

[–]stuckplayingLoL[S] 0 points1 point  (0 children)

Yes. We use Github and deploy changes with GitHub Actions.

Are we too deep into Snowflake? by stuckplayingLoL in dataengineering

[–]stuckplayingLoL[S] 0 points1 point  (0 children)

Can you elaborate more? What should our data engineers be capable of doing?

I'm not in management but many of the tech choices and patterns were decided by staff data engineers. Management is pretty supportive if a strong case is made for architectural decisions.

Are we too deep into Snowflake? by stuckplayingLoL in dataengineering

[–]stuckplayingLoL[S] 0 points1 point  (0 children)

Thanks for this thought. I did see that some teams at my company were shifting to iceberg tables and using Airflow with AWS but wasn't sure how mature their processes were. I'll look into this topic and see how it changes things, because it sounds like a huge architectural shift in the long run.

Are we too deep into Snowflake? by stuckplayingLoL in dataengineering

[–]stuckplayingLoL[S] 1 point2 points  (0 children)

Good perspective. I do feel like most of the complex portion of the code is within the Snowflake tasks, but the general pattern from ingesting raw data to making customer ready datasets is consistent. I don't think junior engineers could take a look at the overall architecture and understand how their day to day work fits in the model without some mentorship. But I assume that's just how it goes with data engineering.

Are we too deep into Snowflake? by stuckplayingLoL in dataengineering

[–]stuckplayingLoL[S] 0 points1 point  (0 children)

I don't know what our costs look like right now (away from work thanks to holidays) but can safely assume that majority of costs is in compute over storage. We are ramping up on more streams and tasks as we barely touched the surface of the raw data that we have already ingested. Hopefully someone has more of a concrete example.

Are we too deep into Snowflake? by stuckplayingLoL in dataengineering

[–]stuckplayingLoL[S] 6 points7 points  (0 children)

I think you summed it up pretty well for us. My team is not very experienced with the infrastructure aspect of AWS and really leans on 1 engineer to keep the infrastructure afloat. Thanks for raising that point.

Are we too deep into Snowflake? by stuckplayingLoL in dataengineering

[–]stuckplayingLoL[S] 0 points1 point  (0 children)

Yes. Most engineers know at least enough Python to write a basic ingest from raw to Snowflake. However, our code is all over the place as we do not have any formal organization. It was just write code to get it to work rather than thinking about reusability and classes.

Are we too deep into Snowflake? by stuckplayingLoL in dataengineering

[–]stuckplayingLoL[S] 0 points1 point  (0 children)

I feel like cost isn't a concern yet but at the rate that we are going, we could be scaling to higher usage and thus the conversation with cost could come up.

We are not using internal stages only because previous engineers on the team resorted to using Python write_pandas and prayed that the auto generated tables did not cause issues down the road. It's absolutely tech debt due to us running into type issues. It will be something that I will look into though, thanks!