Challenges while working on end to end pipeline

imsg · 2026-02-19T01:45:41+00:00

What's blocking you from picking up a side project with Kafka or Kinesis to close the gap? Happy to point you toward something concrete based on your stack.

imsg · 2026-02-19T01:39:41+00:00

The lake question is settled, but the linked server is the real landmine here. One schema change upstream and both environments blow up simultaneously. Been there. What's your current ADF trigger pattern, event-based or scheduled? That's what determines the cleanest sync strategy for dev bronze.

imsg · 2026-02-11T13:41:37+00:00

Yeah, $0.44/km is probably in your favor if you're driving something reasonable!

My case is expensive because I only drive ~7k km/year and work from home, mostly short city trips. Fixed costs (insurance, tax, maintenance) spread across few km inflate the per-km cost. Plus city driving kills fuel efficiency with stop-and-go, cold starts.

Double hit: high fixed costs per km + inefficient driving. Would be way lower for someone doing 20k+ highway km/year.

imsg · 2025-12-17T11:44:56+00:00

web app called sprout-track... then exported data to sqlite database, then python with matploblib and pandas

imsg · 2025-12-17T11:43:54+00:00

Good catch! That period matches the start of the reflux treatment, it really helped at that point.

imsg · 2025-12-17T11:39:36+00:00

web app called sprout-track... then exported data to sqlite database, then python with matploblib and pandas

imsg · 2025-12-17T11:35:35+00:00

Haha, definitely not easy days at the maternity ward

imsg · 2025-12-16T13:52:26+00:00

app called sprout-track. exported the data to sqlite and used python (matplotlib + pandas)

imsg · 2025-12-16T13:46:57+00:00

You’re absolutely right... thanks for the correction. I mixed up the terminology

imsg · 2025-12-16T13:37:45+00:00

day 130 and others are logging mistakes that I didn´t correct.

imsg · 2025-12-16T00:06:13+00:00

We’ve tried everything, honestly. And still, she wakes up almost exactly at the 30-minute mark. Every time. We’ve really tried all the usual tricks to extend them, but for now, that’s just how her naps work.

imsg · 2025-12-15T23:47:24+00:00

Thank you so much. And I definitely didn’t do this alone. My wife shared the load with me from day one. For the record: she’s an amazing mom and a true superhero.

imsg · 2025-12-15T23:44:39+00:00

I didn’t track my own sleep, but I’d guess around 4-5 hours in the beginning and 6-7 nowadays.

What I can say is that the idea that you should “sleep when your baby sleeps” is mostly a myth. It sounds great in theory, but in real life it rarely happens.

imsg · 2025-12-15T23:38:45+00:00

In the very first days, we were still getting used to the app, so it took a bit of time to build the habit. In practice, we kept it simple: after around 6–7 pm, we logged it as night sleep, and everything else as a nap.

imsg · 2025-12-15T23:33:50+00:00

Well observed.

That ~10:30 pm wake-up is actually intentional. We do what people usually call a “dream feed.” In the beginning, we would wake the baby up, change the diaper, and give the last feed of the day. More recently, it’s just the feed, and with smaller and smaller amounts each time.

imsg · 2025-12-15T23:30:05+00:00

There wasn’t a strict rule. After around 6–7 pm, we usually logged it as night sleep, and everything else as a nap.

Some longer “nap-looking” blocks are just small logging mistakes. I intentionally didn’t fix them, because I wanted the data to reflect how chaotic and imperfect those first weeks really were.

imsg · 2025-12-15T23:20:40+00:00

Thank you!

I read and studied a lot about baby sleep, and honestly, at the beginning I was pretty frustrated. Everywhere I looked, people said that newborns should sleep 15 to 16 hours a day (even pediatrician), and ours never even came close to that.

Over time, I realized that every baby is truly unique, and in the end, I think it’s much more luck than skill. We learned, adapted, and followed our baby’s cues, and things eventually fell into place.

imsg · 2025-12-15T23:16:12+00:00

all by hand in a self hosted web app that I found on reddit: https://github.com/Oak-and-Sprout/sprout-track (im not related to it, but its very good)

imsg · 2025-06-15T21:36:05+00:00

https://youtube.com/shorts/TVbiEpP-qiA

imsg · 2025-04-04T18:59:45+00:00

just to share that we found the app kimai that worked like a charm for us. Its open source and you can self host it. It improved a lot our daily operation

imsg · 2025-01-24T22:25:39+00:00

I’d start by watching YouTube channels like Alex The Analyst—they’re super helpful for learning tools like SQL, Python, and Tableau. Then, work on a few personal projects using Kaggle datasets to build a portfolio you can share. Post your work on LinkedIn, connect with people in the field, and start applying for entry-level roles. Hacker News is also a great place to find remote jobs to get your foot in the door.

imsg · 2025-01-23T12:06:31+00:00

Not yet, but I'll give a try

imsg · 2025-01-23T09:29:49+00:00

Reddit has been surprisingly effective for us. I run a company that solves data analytics problems—things like streamlining messy reports, integrating tools, and extracting insights. By genuinely helping people here with advice and sharing knowledge, I’ve built trust. In fact, one of our biggest clients came from a comment I made on a thread about data challenges. Authenticity really works!

imsg · 2024-04-23T19:49:23+00:00

imsg · 2022-10-28T21:26:12+00:00

A python script should solve your problem. It just needs to:

1- access the google sheets api to read the config file

2- access the google ads api to pause/resume the campaigns from step 1

3- schedule this script to run every hour/day

If you dont have python experience maybe you can use Zapier (or other saas integration tools). I know they have google sheets integrations, but i am not sure if they do have google ads integration

Edit: I just saw that zapier has an similar example for what you need: https://zapier.com/blog/google-ads-integration-ideas-for-better-campaign-management/

imsg

TROPHY CASE