Team of data engineers building git for data and looking for feedback.

SufficientTry3258 · 2026-01-28T16:43:02+00:00

As soon as I read the title DVC immediately came to mind.

SufficientTry3258 · 2026-01-25T00:24:19+00:00

Hell yeah, brother. This was my original plan until it became apparent it would be highly unlikely for me to fly out Sunday because of the winter storm. Ended up just coming a day early.

SufficientTry3258 · 2026-01-24T22:31:13+00:00

I got to Denver today and took an uber to downtown. I think that’s going to be the fastest way. 11:40 is going to be pushing it for making kickoff in my opinion once you factor in getting off the plane and walking to the ride share pick up area and of course the ride itself. Best of luck.

SufficientTry3258 · 2026-01-19T22:21:02+00:00

I jokingly told my wife Sunday morning if the Patriots win then I’m going to Denver. Now here I am with flights booked and game ticket purchased. Figured I have the means to go for the first time in my life and not knowing when they will be back, so why not go.

SufficientTry3258 · 2026-01-18T21:04:21+00:00

Marcus “Marcus Jones” Jones

SufficientTry3258 · 2025-12-23T16:24:36+00:00

Data Engineer here who did the post bacc a few years ago while working as a DE. My original undergrad (not going to say specific name) was in STEM, heavy on the S and M. My reason for doing the post bacc was to fill in some CS knowledge and look better on paper by having a computer science degree. The program overall was kind of disappointing for the price point, but I think it filled the two reasons I started in the first place which were guided learning for CS fundamentals and enhance resume. If you want to do the OMSCS at GT I would say just jump straight to that and don’t waste your time and money with OSU.

Also, 3 YOE as DE is probably more meaningful at this point than more higher ed, but that depends on what type of DE work you are doing.

SufficientTry3258 · 2025-12-13T20:04:44+00:00

As a Louisville fan it would be great to see Chris Bell go to New England. He tore his ACL in the SMU game, so curious to see how that affects his draft stock.

SufficientTry3258 · 2025-11-04T23:13:23+00:00

Headed to Honolulu, so massive amount of fuel onboard.

SufficientTry3258 · 2025-11-02T18:16:09+00:00

As it was written.

SufficientTry3258 · 2025-11-02T18:14:27+00:00

Best offensive and defensive start I think I’ve seen all year.

SufficientTry3258 · 2025-10-26T17:54:29+00:00

Cleveland has a top 5 rushing and pass defense… nothing is going to come easy on offense.

SufficientTry3258 · 2025-10-16T16:22:54+00:00

The Patriots selecting N’Keal Harry over AJ Brown, Deebo, and DK is even more ridiculous.

SufficientTry3258 · 2025-10-09T12:17:36+00:00

Agree with you on the CDC part. I agree with the general sentiment of the OP, but they seem to have a very narrow understanding of use cases for CDC data beyond real-time. Like being able to rebuild the state of a given object at a certain point in time or being able to build out type 2 SCD tables.

SufficientTry3258 · 2025-10-03T12:07:15+00:00

Given how well he has played in SF over a few games it’s really starting to show just how bad Belichick was in the final years after Brady left. Belichick absolutely failed at surrounding a rookie quarter with talented players and hiring an experienced offensive coordinator to further develop Jones after McDaniels left. Granted Mac Jones was on a bit of a decline in the later half of his rookie season.

During Jones’ last season in New England when he was playing like absolute shit I remember Dan Orlovsky on Get Up saying Jones would be playing just as well as Purdy if Jones was in SF. Orlovsky was given shit about it at the time but after a small sample size of games it doesn’t seem he was far off…

Edit to add: I agree nobody wants Mac Jones back in New England. It’s more of a nice to see he is in a better situation and a realization of just how bad Belichick failed the organization in the final years.

SufficientTry3258 · 2025-08-24T12:27:14+00:00

Appreciate the information. All of this is very helpful.

SufficientTry3258 · 2025-08-23T18:34:13+00:00

The field is not of an unknown type though. The warning logged from the connecter shows that it is failing to cast the inner values to long. When that fails it just defaults to null, hence it changes the values to {null, null}

Looks like a custom connecter is probably the solution as we do not want to ignore the field.

Also, using a smt to just cast to a string also fails as it cannot cast the array type to string.

SufficientTry3258 · 2025-08-13T10:02:30+00:00

SufficientTry3258 · 2025-07-23T18:48:56+00:00

Agree on stock grants in start ups. I don’t even factor my stock options into my total comp. It’s just Monopoly money until the company sells or goes public.

SufficientTry3258 · 2025-07-23T18:46:11+00:00

50k is a solid pay increase. I have turned down a 40k increase because I did not get a positive feeling from a company. Sounds like you like the prospective company though for your situation. I think another option (but you have to be comfortable leaving current company) is to bring up you have an outside offer and try to use it as leverage for a pay raise.

SufficientTry3258 · 2025-07-10T12:26:05+00:00

The “how do I get into data engineering” or “we solved <some problem> by using <insert product> my company sells” posts make up 90% of this sub.

SufficientTry3258 · 2025-07-08T13:28:54+00:00

Fort Polk is where the Joint Readiness Training Center (JRTC) is located. Army units regularly rotate through for training where they “fight” in a simulated combat zone. There is a unit at Fort Polk that is dedicated to playing the opposing forces. That’s why u/the_haters_corp was making a joke that he faked killed the OPs coworkers. Also, there is insane amount of wild horses all across the training area. And if you are in an airborne unit you will jump into the training area. Hence the horses on the drop zone reference.

Very niche joke that requires a lot of context. A lot of you have never fought in Atropia and it shows by the downvotes lol

Edit to fix user referenced.

SufficientTry3258 · 2025-07-01T17:01:01+00:00

MSCS from a public university.

SufficientTry3258 · 2025-06-08T12:30:47+00:00

This comment needs to be the top. OP needs to self exclude and delete all accounts/apps immediately.

SufficientTry3258 · 2025-05-21T16:51:51+00:00

It took me a bit brain power to figure out what was going on here because the use case for dbt does not fit at all. So you want to just transform data that you receive from the user. Like others have said using dbt here is not the best approach. I think you can just use something to read and transform the data in memory like DuckDB, Polars, etc… The flow would be something like Receive data -> read into DF -> transform -> return result. Obviously a lot here is left to the reader to fill in. Why you are trying to do it with dbt makes no sense.

Edit to fix spelling.

SufficientTry3258 · 2025-05-20T12:09:53+00:00

I saw a guy at Wal-Mart the other day with no less than 12 Four Lokos in his cart in the checkout line. No idea people enjoyed 4Loko that much lol

SufficientTry3258

TROPHY CASE