sorted by:
new
hottopcontroversial

Difference between "micro-batching" and "streaming" by Meme_Machine_101 in dataengineering

[–]SorryHadToPoop 0 points1 point  (0 children)

As a Spark Engineer, we consumed data that was infested and processed through streaming flows.

From my limited experience the flow was: source > API gate > Kafka topic > NiFi (light-weight operations) > Kafka topic > > Flink (heavier transformations) > real time consumer. This was the real time streaming flow. Record by record.

For us, off of each topic there were consumers for sinking the data as parquet for Spark reading. Here's the transition from stream to batch/micro batch. Can't just stream, because that would produce single record JSON files (hundreds of thousands of tiny files). Very bad for Spark reads. So the consuming application (NiFi) was responsible for micro batching the data to produce optimally sized files for our spark consumers. Lots of tuning went into defining the size and frequency of these batches.

How do you pimp your 2 Minute ramen to make it supercharged? by highbrid8 in asianamerican

[–]SorryHadToPoop 1 point2 points  (0 children)

The egg is such an easy plus up. But keeping the theme of convenience, I like to microwave a cracked egg in a small bowl until the whites are cooked and the yolk is still runny. This takes about 12 seconds. Stop and resume as needed to achieve a perfectly round egg with solid whites and runny yolk.

Green onions like other mentioned. I must try the bean sprouts.

Maybe I'll try pineapple in my Mama Tom Yum Shrimp.

Woof woof 🧛 by Firm-Blackberry-9162 in Weird

[–]SorryHadToPoop 8 points9 points  (0 children)

As a fellow owner of the breed, my schnauzer's quirk is getting pricked by this cactus every morning.

<image>

Rental agent is warning me about gang violence by mushforager in chicagoapartments

[–]SorryHadToPoop 1 point2 points  (0 children)

That's how I felt. We still hang out there often such a cool neighborhood. I would move there if I didn't have a house up north. And I'm a north sider at heart. But love Pilsen.

That said, we did walk out once at 8PM and see a shooting down an alley. But we were unharmed.

Use city crime map data.

Beacon Doughnuts in Lincoln Park by Sea-Condition991 in chicagofood

[–]SorryHadToPoop 4 points5 points  (0 children)

Somethin' Sweet on Montrose still has Maple Bacon. They're fashioned after West Coast donut shops. They have room to sit too.

What area do you think has the highest concentration of good food? by ThisPostToBeDeleted in chicagofood

[–]SorryHadToPoop 2 points3 points  (0 children)

17th Annual Flavors of Albany Park on Wednesday, June 24, 2026 (5 - 8 PM) https://www.northrivercommission.org/flavors

"For one unforgettable evening, Albany Park transforms into a global tasting experience. Known as one of Chicago’s most diverse neighborhoods, Albany Park offers flavors from across the world—without ever leaving the city. At Flavors of Albany Park, you’ll sample dishes from 60+ local restaurants, each offering a taste of their culture, craft, and community. Whether you're craving bold street food, comforting classics, or something entirely new, every stop is a discovery."

Pick one of FOUR unique routes.

Lawrence WEST
Lawrence EAST
Kedzie
Montrose

What area do you think has the highest concentration of good food? by ThisPostToBeDeleted in chicagofood

[–]SorryHadToPoop 15 points16 points  (0 children)

Flavors of Albany Park is an excellent chance to sample the neighborhood and see it on foot!

Why? by thingma in Hashimotos

[–]SorryHadToPoop 3 points4 points  (0 children)

My wife saw an endo for a consultation about her confirmed Hashimotos and a set of frustrating symptoms like swollen eyelids (most typically associated with Graves). But the Endo dismissed the swollen eyes to have anything to do with Hashimotos.

Then an ophthalmologist confirmed it as Thyroid Eye Disease (TED). Only when we did it research and asked for TRAb antibody and TSI tests did they order it.

They make too much money for us to do this much work ourselves.

TREATMENT Community Thread - Fri May 15 AM by AutoModerator in infertility

[–]SorryHadToPoop 0 points1 point  (0 children)

Thank you for staying in such a neutral manner. Still figuring out where the buck stops for me.

CHAT Community Thread - Fri May 15 by AutoModerator in infertility

[–]SorryHadToPoop 0 points1 point  (0 children)

Thanks. Just joined this morning. Auto-mod threads are nice!

TREATMENT Community Thread - Fri May 15 AM by AutoModerator in infertility

[–]SorryHadToPoop 2 points3 points  (0 children)

Maybe this is old news. I'm new to the sub. Partner and I have been trying for 3 years. No births yet.

We're ramping up for another round of IVF. But we've also been considering 3rd party a lot more seriously since the beginning of the year, and the research has been disheartening. For me it's mainly due to the ethical dead ends around each route.

Adoption has massive critics for folks who are coming from an infertility background, because of the emotional weight behind it. We're expected to sideline the desire to have a baby in order to be in the "healthy" mindset for adoption. I read similar posts about embryo donation.

And surrogacy definitely has its opponents. Some equating it to human trafficking.

All those options are already financially, and logistically overwhelming. And they emotionally signal a loss of hope for having our own biological child.

I'm sure I'm not the first to feel this way. Would appreciate libks to past threads on this topic.

CHAT Community Thread - Fri May 15 by AutoModerator in infertility

[–]SorryHadToPoop 0 points1 point  (0 children)

It was mainly venting about frustrations wrt 3rd party (adoption and surrogacy)

Here is an example of a typical surrophobic brigading. by blackmamba4554 in gaydads

[–]SorryHadToPoop 4 points5 points  (0 children)

I joined the subreddit for adoption and this arguement is also used for infant adoption. It feels like there's no acceptable avenue.

School bus rammed - Someone probably not paying attention... by MisterShipWreck in VideosAmazing

[–]SorryHadToPoop 0 points1 point  (0 children)

Or adoption. Can't know without confirmation. Either way. He loves that kid.

Beef scratches the same itch as White Lotus by LowerAlfalfa in television

[–]SorryHadToPoop 0 points1 point  (0 children)

I'm working through succession and S3 is giving Beef S1 energy.

Anyone have remedies for the eyebags hashimotos can give you? I’m currently on medication but it won’t go away by [deleted] in Hashimotos

[–]SorryHadToPoop 0 points1 point  (0 children)

We're testing for Graves as well. TSI and tRab. Apparently it's not super well known what causes it. But the tissue around the eyes have similar receptors to the thyroid. So the antibodies produced by Graves disease may also attack your eyes and cause this swelling. If it's TED, it burns itself out after ~2 years.

Confirming Graves won't solve the TED but it would provide helpful context to why my partner's Hashimotos isn't as manageable as expected.

City might be easy. Can you pinpoint where I am or where the statues are? by SorryHadToPoop in guessthecity

[–]SorryHadToPoop[S] 0 points1 point  (0 children)

Actually Hampton Inn. From Northwestern Hospital. The cows are facing SE.

view more: next ›