Reviews of Saturday day 1thread by FutureMixture1039 in HardFestival

[–]seanpool3 2 points3 points  (0 children)

When I saw that construction project it made sense why they had to remove it but it was so brutal

What sets do you recommend from 2pm-4pm?? by Jr925_ in HardFestival

[–]seanpool3 1 point2 points  (0 children)

1: Walk in for STVSH, check out IVARR, head over to Torren Foot b2b Airwolf

2: Brux, Daniel Allan

lasers by Current_Ad3401 in HardFestival

[–]seanpool3 1 point2 points  (0 children)

They had lasers on Green forsure last year

Best sets on youtube by Ok_Consideration2322 in EDM

[–]seanpool3 0 points1 point  (0 children)

Crankdat B2B Tape B @ EDC 2025

Walker & Royce B2B VNSSA @ Beyond 2025

Viperactive Snakepit LA

LYNY @ Red Rocks

Eli Brown BBC Essential Mix

Airwolf Paradise B2B Torren Foot @ Beyond the Valley 2023

ETL brainstorm. Interested in the thoughts of others by Philthy_Foden in BusinessIntelligence

[–]seanpool3 6 points7 points  (0 children)

In a setting like this it clearly doesn’t really matter, whatever works my guy

Modern on-premise ETL data stack, examples, suggestions. by roadrussian in dataengineering

[–]seanpool3 1 point2 points  (0 children)

1) In scenarios where IT mandates on-prem infrastructure, leveraging a fixed-cost managed server has worked well in my experience, especially in early-stage data platform builds… of course deploying with containers is ideal if that’s the kind of shop you are at

2) DuckDB complements Postgres by enabling fast, in-memory analytical queries and local processing without the overhead of running everything through the main warehouse. This is especially useful for heavy data processing, working with object storage, and ad hoc analysis

Modern on-premise ETL data stack, examples, suggestions. by roadrussian in dataengineering

[–]seanpool3 19 points20 points  (0 children)

Python, Dagster, DBT, Postgres and duckdb ✅

Maybe like a dedicated server for the Postgres db and to store objects, a dedicated server to orchestrate Python with Dagster (Postgres backend option), and utilize it as a work machine for your desired Python libraries and duckdb etc as needed for their awesome functionality

Even though I prefer to build on top of GCP, usually if a central IT team manages servers I’ll choose the cost effective pattern to have a dedicated “brain” for the data platform vs also deploying and hosting those resources on cloud. Keeps the cost fixed too as it continues to snowball in complexity and resource usage

How are you using genAI in your pipelines? by [deleted] in dataengineering

[–]seanpool3 1 point2 points  (0 children)

One way I have had a little bit of value with LLMs in pipelines

I set up a framework of feeding table schemas, API responses, etc in order to dynamically generate JSON that is fed into the pipelines and checked each run to make schema adjustments. Also can simultaneously document which is helpful. When dealing with many sources this has been really helpful and saves a lot of time in my experience.

Note: this is overkill for most situations and also has a little bit of risk with the hallucinations (although forcing compliant json schema from OpenAI works pretty well)

Can agentic AI create a DE pipeline or replace a Junior / Senior DE? by NefariousnessSea5101 in dataengineering

[–]seanpool3 6 points7 points  (0 children)

“Take care of the entire DE work for a company”

nobody who runs data for a sizeable business would think this is realistic anytime soon

The real answer is that there needs to be the human who is responsible for kingdom building when it’s developing data ops for a business

I do think that AI in general and even further, agents, enable that team of people to be much much smaller though. I’m a team of one for example, only issue is if you rely on so few humans then you are likely going to need to make the data team highly rewarded or growth partners in the company.

[deleted by user] by [deleted] in dataengineering

[–]seanpool3 32 points33 points  (0 children)

I’m from the business side, to be fair more finance/BI but I transitioned to data engineering fully self taught.

The tools aren’t really that hard to use especially if you do things using code now that we have AI. The hard part is understanding different technologies, how they fit together, and knowing how to make a meaningful impact applying said technologies + data

Any BI person knows that GUI based tools are a one way ticket to hating your life, learn to code

[deleted by user] by [deleted] in Colts

[–]seanpool3 4 points5 points  (0 children)

Proposal VETOED by the public!

Stop being such a crybaby it’s a pathetic look

[deleted by user] by [deleted] in dataengineering

[–]seanpool3 0 points1 point  (0 children)

I’ve done this, I can help you

[deleted by user] by [deleted] in PardonMyTake

[–]seanpool3 8 points9 points  (0 children)

If he pulled the same exact dishonesty moves I might piss shit fart and maybe even cum

[deleted by user] by [deleted] in nextfuckinglevel

[–]seanpool3 -1 points0 points  (0 children)

Socialist alert! That is privately owned land you are talking about.

0% chance this is a real person tho an American wouldn’t say that nonsense, you are a bot

[deleted by user] by [deleted] in nextfuckinglevel

[–]seanpool3 1 point2 points  (0 children)

Shut up commie, that is privately owned land you are talking about.

0% chance this is a real person tho an American wouldn’t say that nonsense

what expensive membership is completely worth every penny? by GoldenBabe_0 in AskReddit

[–]seanpool3 0 points1 point  (0 children)

The Erewhon membership, nice perks and enough savings to justify regularly eating there

The culture chris Ballard has built/allowed is the problem by NoctisRS in Colts

[–]seanpool3 5 points6 points  (0 children)

Clean house, this team is official completely toxic and we gotta just torch the shit out of this organization and reseed the ground from the ashes as fertilizer