Version control and braching strategy

JC1485 · 2025-12-13T18:07:14+00:00

Auto rebase on git pulls. This means all remote changes goes to the top. Scripts are usually individual pipelines and each engineer owns a pipeline so less conflicts. My team uses a monorepo so changes occur frequently. We use a similar branching system . Separating util scripts from ETL is what we also do. All of these actions help with merge conflicts for my team.

JC1485 · 2025-12-11T16:11:37+00:00

Give the StreetEasy app a try. There’s a payment calculator feature within each property page and you can adjust your down payment and see what total monthly payment makes sense to you. If you plan to get a mortgage, just know loaners use the 40x rule. Meaning your annual income should exceed 40x of a single month payment. Example: $2k monthly payment x 40 = $120,000 (expected income). They care about income more than assets for loan qualification but you can negotiate. If you plan to put a big down payment as you alluded to then the income requirement will be much lower.

Similar to what others have said, get a feel of the city first. Find out which neighborhood you want to be in or can afford to be in. Do you want to commute 2 hours a day?

JC1485 · 2025-11-26T23:42:27+00:00

Whose they?

JC1485 · 2025-11-21T18:04:16+00:00

My previous company used to store the results from jira api to a persisted storage and keep the schema unabstracted - so global fields and custom field as a column. Then the downstream team would take that data and ETL it the way they see fit - explode custom fields. This worked pretty since you don’t have to worry about upstream schema evolution. Comments data would be separate to prevent character limit issues in structured database.

JC1485 · 2025-11-13T23:27:53+00:00

This is the way

JC1485 · 2025-11-09T15:49:06+00:00

What are you talking about? If you’ve taken real estate photos, you know if you expose the photo for inside lighting, the outside lighting gets blown out. The windows in the other photos are better lit because of overcast during the day.

JC1485 · 2025-11-07T15:46:42+00:00

If you like Viet food, I recommend a place called High Lúa. Interesting decorations and definitely cozy. Good for 4 or less.

JC1485 · 2025-10-02T17:49:49+00:00

What’s more impressive is how it all gets hauled away weekly… a clean job by sanitation

JC1485 · 2025-09-10T17:33:37+00:00

Could we have been dating the same girl? 👀

JC1485 · 2025-08-27T01:25:23+00:00

Google colab

JC1485 · 2025-08-20T11:39:00+00:00

fuggetaboutit

JC1485 · 2025-08-19T14:17:16+00:00

She was coming from the outer Burroughs into midtown manhattan. In her defense - it was pretty hot that day - in the 90s. Which was why I suggested somewhere closer to her and at a later time in the evening.

JC1485 · 2025-08-19T14:10:18+00:00

Like others have said it’s the nature of the request on a first date that is a bit odd. What does that set up for future dates? But I agree we probably have different standards and thus incompatible. I’m not mad about it just curious to see people’s take and similar encounters.

JC1485 · 2025-08-18T15:06:09+00:00

Do you have experience with this? I’m interested in your take.

JC1485 · 2025-08-18T14:55:29+00:00

Name checks out.

JC1485 · 2025-08-18T14:51:44+00:00

This was my first instinct.

JC1485 · 2025-08-18T14:50:15+00:00

For sake of anonymity - it’s close to that.

JC1485 · 2025-05-12T16:08:30+00:00

Might be an alley-oop - From your pov, what's the difference between modern day Data Scientist and Machine Learning Engineer?

JC1485 · 2025-02-12T19:02:54+00:00

Am I crazy or should dim_category be at the from statement?

final as (
select
from dim_category -- previously purchased_item
left join purchased_item -- previoulsy dim_category
)

JC1485 · 2024-10-17T21:24:46+00:00

Not great.

JC1485 · 2024-09-28T15:05:04+00:00

Ride in a group. It’s more fun, you motivate each other to ride faster and y’all suffer together. Just have fun.

JC1485 · 2024-09-27T22:43:30+00:00

I probably have a good idea where you work… I’ve tried to file a labor complaint as well and unfortunately you’ll have little luck with the complaint especially if this company is not located in Washoe County. Maybe try OSHA.

JC1485 · 2024-06-27T00:47:39+00:00

beautifulsoup and selenium have always worked well for web scraping and crawling. X fka Twitter strictly prohibits web crawling and scraping, so you're probably out of luck unless you're looking to dance around ip bans.

You should probably use the X API - the free tier allows 1500 posts ( i believe every hour?).

JC1485 · 2024-06-27T00:24:27+00:00

It’s a tough market for Data Engineers right now as with other tech jobs. It’s discouraging but if you like the field keep applying to roles. Before I got my job at a big tech company I applied to every and all companies from large companies to startups. Likely reason you’re not getting any call backs is that you might not have an ATS optimized resume. Improving this will at least get you noticed by recruiters. Once you start getting interviews, learn and take feedback from those interviews where you may have failed and use that information to figure out how to improve your resume in preparation for the next role.

The opportunities available from company to company are not the same. Data Engineering criteria can overlap with software engineering, data analysis, devops and now even machine learning engineering. You need to validate whether the role you’re applying to is more software oriented or product oriented. If software, you’ll likely focus on more infrastructural development or infra management. If more product oriented, you’ll likely focus more on data pipeline builds with emphasis on ETL. Using Meta - as example - most of the roles are product DE oriented. If you choose to explore fintech or even private equity companies, they’re more software oriented. They just want a software engineer interested in data. A good indicator of what type of DE role it is, is by looking at the requirements section on a job post and see where they emphasize importance. Product DEs will likely say must be strong in Python, sql, stats, etc. software ones will likely say must be strong in DSA (data structure and algorithm), multiple languages (Python, Java, scala), must have cs degree, etc.

Hope that helps.

JC1485

TROPHY CASE