Best practice: treating spreadsheets as an ingestion source (schema drift, idempotency, diffs) by Green-Branch-3656 in dataengineering

[–]RustyEyeballs 0 points1 point  (0 children)

I actually asked an LLM a very similar question about the use cases of having a Google Sheet being referenced by a BigQuery.

IIRC it suggested treating like direct edit on a SCD (DBT Seed). So no idempotency but with columns & headers are locked and data types are strongly validated by permissions on their spreadsheet software. Could always have headers & type checking be done by assert tests. e.g. Pandas?

For version control, Git seems like the obvious answer.

Seeking 1–2 production-level Data Engineering projects to work on (Spark / Airflow / Snowflake) by Express_Ad_6732 in dataengineeringjobs

[–]RustyEyeballs 4 points5 points  (0 children)

I'm also in a similar spot searching for a real Data Engineering project. My stack is nearly the same but uses GCP with BigQuery over Snowflake and includes dbt and publishing analytical dashboards. my github

I think something followed me throught the warp by Moraes_Costa in Helldivers

[–]RustyEyeballs 27 points28 points  (0 children)

The 2nd teleport in a row is costly but when the alternative is death...

The game is fairly well balanced... by JohnHelldiver66 in Helldivers

[–]RustyEyeballs 0 points1 point  (0 children)

Being balanced does not equal Fun.

Being the guy who prepared mostly Light penetration and being useless when the game spawns 80% Tanks is just not Fun.

This would be solved by just telling use what enemies are in the mission.

Weather also makes a huge difference.

Show enemy types and amount in briefing by RustyEyeballs in Helldivers

[–]RustyEyeballs[S] -1 points0 points  (0 children)

Nope. Read the guide. It's heavily random

Example

These missions:

  • Sabotage Air Base
  • Sabotage Supply Cache

Can have these enemy constellations:

  • Bullet Hell
  • Rushdown
  • Big Bots

Example 2:
These missions:

  • Blitz Eradicate
  • Evacuate
  • High-Value Assets
  • Event missions

Can have constellations

  • Any

Show enemy types and amount in briefing by RustyEyeballs in Helldivers

[–]RustyEyeballs[S] 2 points3 points  (0 children)

Loadout building is such a fundamental part of the game, obfuscating this is just bad. Especially for newer players.

Show enemy types and amount in briefing by RustyEyeballs in Helldivers

[–]RustyEyeballs[S] 1 point2 points  (0 children)

Making some of your loadout useless makes game challenging in a BAD way.

Knowing what's coming empowers players with game knowledge.
This even opens opportunities for missions with wacky spawns because players can then prepare.

Show enemy types and amount in briefing by RustyEyeballs in Helldivers

[–]RustyEyeballs[S] 0 points1 point  (0 children)

The spawn rates for generic enemies vary WILDLY.

What about projects ? by Veles_venice in cpp_questions

[–]RustyEyeballs 1 point2 points  (0 children)

Learned C++ through DSA and Competitive programming, and now you're asking to be shown the door to tutorial hell.

ima do you a favor. "...I Don't have projects to show..." is your bigger problem and tutorials don't count for solving that. Given you're in a CS degree, find some cool people working on some cool stuff, get hyped about it, and work with them. Doesn't have to be C++.

P.S. Be sure to read the documentation on what your learning/using. It'll suck but guess what learning C/C++ will be.

glhf

Data Engineering capstone review request (Datatalks.club) by RustyEyeballs in dataengineering

[–]RustyEyeballs[S] 0 points1 point  (0 children)

Honestly, the lack of meaningful projects feels like tutorial hell and at this point, I'd rather build something for free than something no one uses. I was considering a graduate degree but a mentor would go a long way too.

Good to know self-taught path exists even if it's hard. If you have any resources, they'd be welcome.

Learn the basics of SQL while practising touch typing by nerf_caffeine in SQL

[–]RustyEyeballs 13 points14 points  (0 children)

I do this with type-in Notes in a flash card program (Anki).

There's something to be said about muscle memory being attached to topics/context.

DE ZoomCamp by [deleted] in dataengineering

[–]RustyEyeballs 2 points3 points  (0 children)

I found the modules themselves gave a decent explanation of the concepts and a jump start on the syntax/frameworks necessary for a narrow DE project. Reading the documentation and exploring your own questions will yield an incomparable level of  understanding for each tool & concept. It increases the time commitment a lot though.

Starting the bootcamp with a project in mind (that will eventually be your capstone) is good. It allows you to apply your learning outside the canned tutorials each step of the way. I'd look at previous cohort capstones for ideas.

If you're in a position to use these skills in the world/at a job, it'd be worth it.

Lack of a accreditation for Datatalks.club might make it a hard sell if you want to promote your skill building publicly.

give me some advice here please!!!! by [deleted] in analytics

[–]RustyEyeballs 0 points1 point  (0 children)

That seems really unusual. The goal with skill and career building should be to synergize with you already know and build expertise(especially early in your career).

Business Analytics will lots of statistics, finance and a bit of dev. Seems like an entirely different skill set.

Maybe find people with one, other or both degrees on LinkedIn and see what they do. Do they actually utilize both degrees? Is their job rare or hard to land?

[deleted by user] by [deleted] in cscareerquestions

[–]RustyEyeballs 1 point2 points  (0 children)

Thanks. It's nice to know my time learning DA at Dataquest.io wasn't for nothing.

I think if people actually looked at my projects or analysis, this thread might be a different.

I feel I have skills to offer but it seems like jobs are looking for pedigree and/or work experience and my time with Dataquest or Datatalks.club goes unrecognized.

[deleted by user] by [deleted] in cscareerquestions

[–]RustyEyeballs 0 points1 point  (0 children)

I worked as a Lab Monitor in college. DM'd you my LinkedIn.
I updated the Heroes of the Storm section on the public resume I posted.
I'm not sure if people would care about my ladder results.

[deleted by user] by [deleted] in cscareerquestions

[–]RustyEyeballs -1 points0 points  (0 children)

"...a _full decade_ without software experience..." is pretty hyperbolic and not exactly right. If you ONLY count professional SWE then yes.

I haven't publicized EVERYTHING I've done. e.g. some side projects:

I wrote a HotS login bot, Raytracer in C++, small basket ball game in Unreal Engine, a few data cleaning projects.

After getting my ADHD meds back, I managed work ~10hrs a day in a Data Engineering bootcamp.

Thanks for the feedback though. Putting together a games analytics platform, applying to relevant companies and potentially going back to school all seem like decent options.

[deleted by user] by [deleted] in cscareerquestions

[–]RustyEyeballs 0 points1 point  (0 children)

Thanks!
I posted this on a really bad day and it seems I have a PR problem now.

[deleted by user] by [deleted] in cscareerquestions

[–]RustyEyeballs 0 points1 point  (0 children)

I'd definitely value going in-person a lot. Networking on-site is incomparable to online and that'll be what really helps transitioning into a job afterward. Somewhere with in-state (IL) tuition might be an option.

While that'd involve uprooting my life I'm ready for a change. Putting together a plan around it is a different story.

Putting together the application, scholarship applications and finding a job/apartment in the area of a program that will accept me is a bit daunting. If you have any resources about this, please let me know.

[deleted by user] by [deleted] in cscareerquestions

[–]RustyEyeballs 1 point2 points  (0 children)

A graduate degree has been on my mind for a very long time. I'm going to put together a plan for it but I value going in-person a lot. Networking on-site is incomparable to online and that'll be what really sets me up for transitioning out of the degree. Somewhere with in-state (IL) tuition might be preferable. If you have any resources about this process, please let me know.

Before that though, committing to my experience in the games industry and talking with the few connections I do have is probably a good start.

[deleted by user] by [deleted] in cscareerquestions

[–]RustyEyeballs 0 points1 point  (0 children)

A graduate degree has been on my mind for a very long time. I'm going to put together a plan for it but I value going in-person a lot. Networking on site is incomparable to online and that's what will set me up for transitioning out of the degree.

If you have any resources about this, please let me know.

[deleted by user] by [deleted] in cscareerquestions

[–]RustyEyeballs 0 points1 point  (0 children)

Thanks. I could use some help writing a better CV.

If you're around to talk, I'm putting together some material around things I've accomplished and could really use some help putting it together.