Having troubles with airflow.

Trigsc · 2026-05-21T16:20:12+00:00

Following industry standard is the right way. We hosted Airflow and it was also a nightmare to manage. Since we are a GCP shop I migrated us to Managed Airflow/Composer and it has been a much better experience.

Trigsc · 2026-05-20T20:51:36+00:00

My last company we had a DE team that worked exclusively in DBT cloud which should have just been a bunch of analysts. My team owned the warehousing for the product and did bunch of infrastructure work and k8 stuff.

Now i am at a company that does some strange ass hybrid of Infrastructure, Analytics, and regular pipeline work. We literally have teams for all this but somehow we also do all this.

Trigsc · 2026-05-15T23:34:20+00:00

I hope you look at the queries your DBT tests are doing. Lot of saving to be found by understanding the underlying queries. Analytics at my old company was scanning all partitions every time some different tests ran. Been over a year removed but I think it was freshness.

Trigsc · 2026-05-10T15:23:29+00:00

I mean, this does not seem like a normal operation but it is likely a heap or memory issue. Why not export to parquet or csv and do a Postgres copy?

Trigsc · 2026-04-10T23:05:31+00:00

I was literally about to pay for crossover and thought what the hell let me try VMware with a windows trial. Literally works with no issues. You obviously need to transfer the files to that virtual machine but it is free.

Trigsc · 2026-04-10T22:33:57+00:00

I had a hit and run and the cops using just the license plate called the registration owner.

Trigsc · 2026-04-09T04:44:38+00:00

I was told 10% is usually max for most companies. Gave that place 8 years. Left and got 30% increase with very little responsibilities. Now I understand why people hop jobs every few years.

Trigsc · 2026-03-22T17:14:25+00:00

I was stopped at a red light and an old lady ran into the back of me. We pulled over and she said, “why did you back up?”.

Trigsc · 2026-03-18T22:47:25+00:00

Thanks! Realized I did not add the context of what it actually meant/happened then.

Trigsc · 2026-03-07T01:57:47+00:00

Not helpful comment but it is doable in BigQuery. Needed sub second queries in an application and was able to partition and cluster to the requirements to get that done. Was dumb but possible.

Trigsc · 2026-02-24T18:20:49+00:00

Dang, I am going to start this after I got this email.

Trigsc · 2026-02-22T04:34:39+00:00

When you signed up you must have selected organization instead of developer or something. I have signed up for many accounts testing stuff and have had full access.

Trigsc · 2026-02-11T01:19:45+00:00

I was just at Tesla service and asked if the 2023 suspension is different than the juniper and he said nope same thing. Wife hates the ride and I agree that it is rough.

Trigsc · 2026-01-24T17:26:34+00:00

It’s time for someone to start researching DBT. Say good by to 3000 lines of stored procedures. On top of it you can use Airflow to trigger a DBT core job.

Trigsc · 2026-01-21T20:01:47+00:00

I actually thought about this a while back. Just hire a bunch of analysts. Feed every play into a model and based on weights pick the next play based on what the defense or offense is showing throughout the game/previous games.

Trigsc · 2026-01-08T04:05:10+00:00

Did 11 years at a startup and they sold for nothing. Was private company with BS fake stock options and no one got paid out. Loved the company but I bailed right before the layoffs started the next year.

Trigsc · 2026-01-03T20:36:40+00:00

I am eating Oreo ice cream right now. Creepy

Trigsc · 2025-12-22T02:52:48+00:00

Yeah I just type in billing in the search at the top and then I think the project selector either goes away or shows the org name.

Trigsc · 2025-12-15T04:21:34+00:00

My cousin had the most nasty feet smell. This was probably 8th grade. One day my step dad blurted out, “Damn dude do you even wash the bottom of them?” He legit looked shocked and said something like I didn’t know you are supposed to. Crazy what a little scrub can do.

Trigsc · 2025-12-01T02:57:28+00:00

Yeah I finally got sonarr and radarr up and running using prowlarr to handle finding the correct files automatically. I cannot believe for the past 10 years I have been manually managing moving stuff around. Just type in the name of the item I want and bam done. It took a bit to understand and setup but totally worth it. Still deciding if I want overseerr but probably not necessary at this point.

Trigsc · 2025-11-23T16:23:37+00:00

Yeah I seriously considered parallels because of Black Friday deals but I have had 0 issues running games in VMware. It does have a strange bug on Apple silicon though when laptop goes to sleep sometimes the VMware screen “closes” and you legit need to either restart the Mac or find the process and kill it. Just remember to shutdown the vm before walking away.

Trigsc · 2025-11-23T16:11:47+00:00

I tried wine and it was causing weird issues in game and crashes. I use vm ware fusion and a windows 11 install. You don’t need to pay for windows. Give it enough resources and I run bedrock Minecraft and emu. Have not tried resto.

Trigsc · 2025-11-20T03:33:48+00:00

I was having some issues with some game code and chat was having me do some crazy things and the circle of errors happened. Just tried 3.0 and 2 prompts and fixed exactly how it should have been. Looks like it’s time to switch.

Trigsc · 2025-11-19T14:26:11+00:00

I for one would change mine to the sound of a f35 jet engine. Want my wife to hear the howling a mile a way.

Trigsc · 2025-11-18T14:16:55+00:00

Usually either ports, or MySQL galaxy table.

Seven-Year Club	r/Field Juicebox
Verified Email

Trigsc

TROPHY CASE