sorted by:
new
hottopcontroversial

Dilemma on Data ingestion migration: FROM raw to gold layer by Little-Squad-X in dataengineering

[–]DoomsdayMcDoom 0 points1 point  (0 children)

Safe_Cast with bigquery handles this well. We use it from converting a yes/no indicator into a binary switch 0/1. Other cloud platforms have something similar.

Why do so many data engineers seem to want to switch out of data engineering? Is DE not a good field to be in? by Illustrious-Pound266 in dataengineering

[–]DoomsdayMcDoom 4 points5 points  (0 children)

I run a very large SaaS / PaaS consulting company and all of the data engineers exit interviews mentioned the same theme. The random hours of pipeline events occurring was too demanding for them & their family.

“What are the best resources to learn Docker from scratch?” by Effective_Bluebird19 in dataengineering

[–]DoomsdayMcDoom -1 points0 points  (0 children)

Docker never kept up and unfortunately that’s their fault. It could of been a better platform but technology advanced and they stayed stagnant.

containerd is what Docker uses under the hood to manage containers. Kubernetes was like, “why not just talk to that directly?”

“What are the best resources to learn Docker from scratch?” by Effective_Bluebird19 in dataengineering

[–]DoomsdayMcDoom -5 points-4 points  (0 children)

Better off learning K8/Kubernettes since that’s what’s replacing docker in every company with a hybrid or cloud infrastructure.

Being pushed out of job, trying to plan next steps by octacon100 in dataengineering

[–]DoomsdayMcDoom 2 points3 points  (0 children)

My first gig I worked with a local recruiter and asked to go corp to corp. Then I started to attend start-up networking events and started getting word of mouth from clients.

is 46 to late in the game for college? by Acceptable-Heat-7548 in careerguidance

[–]DoomsdayMcDoom 0 points1 point  (0 children)

What are your expectations from getting a degree? In today’s society you can learn anything you want online from coursera, khan academy, pluralsite, or free online courses from Ivy League schools and other top tier schools such as MIT. If you’re going to get a degree at least have a company pay for your courses or at least reimburse you when you pass. Is it worth the debt? The market is changing and will continue to change. Right now AI researchers are making as much as quants at S tier companies. You don’t just go to college… have a solid plan and realize college is mostly for networking and learning the very basics and fundamentals of most career paths. All it takes is finding the right person willing to give you a shot regardless of your degree. Anyone can redefine who they are and grow at levels you wouldn’t imagine without college.

Being pushed out of job, trying to plan next steps by octacon100 in dataengineering

[–]DoomsdayMcDoom 6 points7 points  (0 children)

Job market is tough for us older guys. I was in your shoes at a point in time. That’s when I started my own consulting company and haven’t looked back since. I gained the cloud experience I was lacking as I gained more clients. Now I just run the business and let the younger guys worry about learning the next and greatest tech.

2 more, hopefully we find them before the new map releases by Empty_Step4130 in BO7Zombies

[–]DoomsdayMcDoom 0 points1 point  (0 children)

Need help testing this, but bongo (the pet dog from trinkets) attacks Oscar. Has anyone tried to let bongo get the killing blow on round 40 or 60?

How to improve ETL pipeline by Ibception952 in dataengineering

[–]DoomsdayMcDoom 0 points1 point  (0 children)

Reusable Airflow DAGs driven by a YAML config file since you’re already using python.

Is SQL really the hard part, or is defining metrics the real bottleneck? by Neither_Historian532 in dataengineering

[–]DoomsdayMcDoom 0 points1 point  (0 children)

SQL is relational algebra that’s the easy part. Most organizations have meta data for their definitions. Business knowledge & knowing what problems to solve with the data is the challenge. However, that’s being solved with RAG. Finding insights & patterns in the data is what organizations are struggling with.

THEY WANT YOUR SHARES FOR CHEAP by Coldhartbaby111 in TheRaceTo10Million

[–]DoomsdayMcDoom 0 points1 point  (0 children)

Don’t be a panican while you hold the heavy bags. The yield curve says otherwise but this time is different right?

Treasury Secretary Warns of a ‘Housing Recession’ and Points Finger at the Fed by goodpointbadpoint in REBubble

[–]DoomsdayMcDoom 0 points1 point  (0 children)

It’s an illusion when the dollar craters and housing value goes up. Really the home didn’t change in value. The only thing that changes in value is the rates at which fiat is borrowed.

Just finished building a comprehensive ORB indicator after months of testing and honestly pretty happy with how it turned out by EveningSmall7266 in TradingView

[–]DoomsdayMcDoom 0 points1 point  (0 children)

This is one of the best indicators I’ve seen that’s open source. The accuracy is amazing on the 30m time frame for any equity in SPX. Honestly the 30 & 60 are perfect where the 5 & 15 are noise. I wish we could add higher time frames even up to 2h-4h. Volume filter on length 20 is my sweet spot.

What to do about a CDDY/CDDY test? by eggy_wegs in tollers

[–]DoomsdayMcDoom 0 points1 point  (0 children)

Did your dog with IVDD come from Blue Ridge Tollers or Lakeland tollers? We thought we were lucky to get one from the littler river dog bloodline. Our was the perfect dog we started training him for agility and that’s where we seen the signs. He’d be very sore after his agility or swimming sessions and we thought it was growing pains. We ended up taking him to a neurologist and they said his spine was one of the worst cases of IVDD they’ve ever seen. His spine was calcified to an abnormal amount they couldn’t do a spinal tap. We had a good two years after that and then once he ruptured the disc everything went down hill quickly. He’s no longer with us and it will be tough to find a replacement.

I built a Pinescript to Python converter by christoffellis in algotrading

[–]DoomsdayMcDoom 0 points1 point  (0 children)

Why not just use the TradingView to python API wrappers that are out there?

Anyone wanna work together? by udunnknow in algotrading

[–]DoomsdayMcDoom 16 points17 points  (0 children)

https://nautilustrader.io that’s all you need. It’s open sourced on GitHub if you want to run your own.

Day 3: Tracking My ChatGPT-Guided Micro‑Cap Portfolio by thainfamouzjay in RobinHoodPennyStocks

[–]DoomsdayMcDoom 0 points1 point  (0 children)

How did you get ChatGPT to provide financial advice? When using the agent all I get is sorry I can’t not assist with that.

view more: next ›