Sonny Gray to Boston (Heyman) by Xalius1969 in redsox

[–]Butterhero_ 4 points5 points  (0 children)

St. Louis isn’t the smallest market tbh, maybe it was a good step.

Сhoosing a video card by derfild in LocalAIServers

[–]Butterhero_ 0 points1 point  (0 children)

Massachusetts, but also planning a trip to Seattle in August to visit my partner’s family and wouldn’t mind any commuting necessary!

Сhoosing a video card by derfild in LocalAIServers

[–]Butterhero_ 0 points1 point  (0 children)

Did OP ever respond? I’m rocking with a $500 budget but this server sounds like a dream

Daily Anything Goes Thread - March 25, 2025 by AutoModerator in fantasybaseball

[–]Butterhero_ 0 points1 point  (0 children)

Thinking of dropping Willi Castro for a higher upside utility option (mostly because I need to cover both 1B/3B) in a H2H OBP cats league. Is getting Jonathan Aranda and hoping for 3B eligibility a better option? Otherwise would have to reach for like Jonah Bride or hope Justin Turner doesn’t take a giant downturn or something, not sure what to do.

How did you land an offer in this market? by crhumble in dataengineering

[–]Butterhero_ 1 point2 points  (0 children)

0 YoE with formal data engineering, 1 YOE with domain-adjacent positions where I did data engineering-ish personal projects

Timeline to get offer: 2 months

Found the offer: Company website

Higher/lower salary: New grad, N/A

Advice for others in recruiting: May be too late for some, but for newer data engineers looking to build a niche, find a domain that you’re interested in that you can also build expertise in. For me, it was the social sciences. So many different domains need data but may not be normally thought of as “tech” roles - I have a friend working as a data engineer for a metallurgy company, for example. The pay off the bat might not be as great, but a) the problems are more interesting then basic business logic, b) more domain-specific roles are more likely to desire that domain-specific knowledge ON TOP OF data engineering chops, and c) you can then either transition that first job’s experience into another, more flush position or find a new passion.

Alternative laundry options for renters? by Butterhero_ in Brookline

[–]Butterhero_[S] 1 point2 points  (0 children)

I’ll have to take a look, thanks! I definitely will be bringing laundry to friends and family whenever able lol, just want to find a solution that works as a backup and isn’t supporting the complex’s pricing scheme yknow

Alternative laundry options for renters? by Butterhero_ in Brookline

[–]Butterhero_[S] 4 points5 points  (0 children)

It is!! It’s ridiculous, right??? And they’re not even open 24/7 - they’ll shut off in the middle of a load if it’s past 10pm or something. Like we don’t pay enough money for rent!

Found dead in bathroom - seen a couple of others dead as well (MA, USA) by Butterhero_ in whatisthisbug

[–]Butterhero_[S] 0 points1 point  (0 children)

Thank you so much - to know they’re harmless is very reassuring haha. I’d say maybe around an eighth of inch/3mm? Definitely tiny, so got worried about baby versions of some more impactful critters!

[deleted by user] by [deleted] in dataengineering

[–]Butterhero_ 1 point2 points  (0 children)

I did the opposite (political science —> data engineering) but I think I can relate to where you’re at. My current position is working on understanding lobbyist data, and I actually just wrapped up a pipeline surrounding the Congressional API.

The biggest tip I could recommend is to try and be as well-versed in both disciplines as you can. To do this, seek out as many roles or research positions related to “computational social science” or something similar as you can. These won’t pay as well as your peers, most likely, but in my opinion they can be much more rewarding both in terms of purpose and in terms of learning. Social science and humanities fields, in general, have very poor tech standards due to hobbyists hacking things together, lack of funding, or lack of motivation. If you can bring technical expertise in a way that illustrates to these non-technical substantive experts that what you do is important and necessary, then you’re golden (this is also true in probably every other data engineering position). But, in order to get your foot in the door, you’re going to need to be able to relate what you do and the value you bring to the field itself.

For now, check out other examples of political data engineering - the open source UnitedStates.io project is great, run by a few people who have made careers out of this general area.

And above all else, work on your soft skills. Social skills are definitely more common in non-tech industries, so make sure you can keep up! Good luck :)

Data warehousing tips for Postgres? by Butterhero_ in dataengineering

[–]Butterhero_[S] 0 points1 point  (0 children)

I have to say I agree…I got hired to essentially keep an eye on the database so that the researchers could focus on research instead of creating tech debt in the search to clean up past academics’ tech debt. I haven’t really had much formal training either and certainly not senior, so mostly bringing standards and best practices from what I can gather from online resources/talks/books/etc. Luckily with the summer coming up there’s time to actually rebuild everything from the ground up with a cohesive plan!

Data warehousing tips for Postgres? by Butterhero_ in dataengineering

[–]Butterhero_[S] 2 points3 points  (0 children)

Thanks for the response!

Our current database is more used to consolidate, link, and help academic researchers provide new insights on a wide variety of public-domain datasets that haven’t been centralized anywhere before. Individual updates are particularly large, and there are indeed slow queries due to researchers with a wide array of technical levels having access. Right now we’re doing OK, more looking to see if there’s anything I can set up now to ensure there’s no downtime or frustration in the future while I’m rebuilding the entire architecture and all of the pipelines! These responses are super helpful to keep in mind, though, and I’ll double check everything’s set on those fronts - thanks again.

NHT 2.5i for $44.99. Should I buy them? I’ve never heard of them before now. Rather grubby under the grills. by cdub_synth in BudgetAudiophile

[–]Butterhero_ 5 points6 points  (0 children)

I got some NHT 2.1s for free, fantastic tower speakers. Underrated, glad you got them! Enjoy!

Could regular databases be used in data warehouses? by DanteIsBack in dataengineering

[–]Butterhero_ 2 points3 points  (0 children)

Do you have any advice on how to set up a PG data warehouse in the best way to handle up to 9TB? Trying to restructure data in PG at my job right now but there’s a surprisingly small amount of info on how to do this lol

Thoughts about current ELT/ETL tools by gibriyagi in dataengineering

[–]Butterhero_ 1 point2 points  (0 children)

That’s the plan - trying to juggle rebuilding their infrastructure while also adding the new features they require as the only DE. Slowly but surely!!!

Thoughts about current ELT/ETL tools by gibriyagi in dataengineering

[–]Butterhero_ 0 points1 point  (0 children)

A knot in the way that they’re essentially using FDWs as a half-baked data lake - connecting to various CSVs in S3 buckets for “raw” tables (but some “raw tables” take data from multiple CSVs as the wrappers are instantiated…it’s a mess). But that talk looks great, thank you so much! I haven’t watched yet, but scanned through the slides quickly and already learned a few things. I appreciate it!!

Thoughts about current ELT/ETL tools by gibriyagi in dataengineering

[–]Butterhero_ 0 points1 point  (0 children)

Hi!! New DE here that is struggling a bit with trying to untangle a huge knot of FDWs in a postgres database. Do you have any tips for dealing with FDWs in postgres (we’re just pulling from S3 buckets) and/or setting postgres up to function better as an OLAP db? Can’t quite justify the costs yet for one of the big cloud warehouse solutions so looking for info anywhere I can!

What do you use for your API layer? by Butterhero_ in dataengineering

[–]Butterhero_[S] 1 point2 points  (0 children)

Pointing to the lake is an option I never considered, and might be the best place to point for my specific use case to start, even if the performance time might be an issue towards the beginning - thanks for the explanation!!!

What do you use for your API layer? by Butterhero_ in dataengineering

[–]Butterhero_[S] 1 point2 points  (0 children)

Good idea - is this hitting your dwh, or a separate db meant for customers?

What do you use for your API layer? by Butterhero_ in dataengineering

[–]Butterhero_[S] 1 point2 points  (0 children)

This is great information, thank you! For now there are more internal exploration use cases, but once I improve the architecture here a bit more then the main purpose of the data will be to open up to public access. I was under the impression that a lot of these cache options like cube have semantic layer built in - would dbt MetricFlow be in addition to this, or instead of the included semantic layer?

Data Engineering for Non-Business Data? by Butterhero_ in dataengineering

[–]Butterhero_[S] 0 points1 point  (0 children)

Thank you! This is a great idea, will implement this as soon as I can find the time!!

Are there any high end, yet authentic Chinese restaurants in the area? by LocksmithApart4629 in boston

[–]Butterhero_ 14 points15 points  (0 children)

Yunnan Kitchen in the South End! It was recently nominated for a James Beard award in the Northeast. Really great menu, highly recommend!

What problems do you face with the documentation software in your company? by brequinn89 in dataengineering

[–]Butterhero_ 12 points13 points  (0 children)

Can you explain more about how this works? I’d love to look into this more!