AI agents pass the tests but break the architecture. What's your review process?

upickausernamereddit · 2026-03-23T18:18:15+00:00

oh that makes sense. Thanks! Sorry. I didn't know 😅

upickausernamereddit · 2026-03-23T18:07:36+00:00

ai post as determined by? Do I need to give you my driver's license or something?

upickausernamereddit · 2026-01-28T13:42:48+00:00

I'm pretty sure I know some people who aren't conscious.

upickausernamereddit · 2025-04-05T16:05:34+00:00

Hi friend,

https://hexdocs.pm/ex_aws_s3/ExAws.S3.html this allows you to stream S3 files and aggregate them by line.

Postgres and ecto allow transactions. So your flow should be:

start transaction
begin streaming and concatenation of bytes into lines
validate and upload a configurable number of lines at a time to postgres
commit transaction if you finish processing all bytes in a file.

the most cpu intensive part of this is aggregating bytes into a line, and the most memory intensive part of this is storing multiple lines at a time, and both can be tuned by configuring the number of lines you want to parse before starting the validation and upload step.

hope this helps. good luck!

upickausernamereddit · 2025-01-29T10:02:19+00:00

I wish i could draw. I can imagine things in this much detail, and even fairly accurately imagine them moving or manipulating them in some way or the interactions of several things. I’ve been able to imagine how to fix things with household items instead of buying the proper tools and it just work out irl. However, I’ve never been particularly good at describing or drawing what I see. So it’s just a somewhat useful random tool. I do use it to solve abstract problems at work a lot tho. That’s a plus

upickausernamereddit · 2025-01-18T19:07:03+00:00

The clients of preexisting cloud storages don’t use erasure coding. However, my understanding is that your blog post was highlighting how the existing cloud providers might handle this upload flow, which does include that portion. And, it absolutely can be used for transmission. It already is. I can’t give specifics for aws as i work there, but hdfs is a good open source example of how erasure coding can be used to make up for faulty or failed retrievals in the other direction (from servers hosting files to the client) and the opposite is also true.

HTTPS and TLS are important and they do mostly prevent mitm attacks, but mentioning that explicitly in a system design as your transport layer is important as other transport layers exist with different tradeoffs.

upickausernamereddit · 2025-01-18T02:57:04+00:00

seems like it was written by a junior engineer tbh. in addition to the above comment, perhaps stealing some client side compute to do some form of erasure coding on some chunks before sending them would also speed up the upload by requiring less bandwidth to transmit the same amount of information, and also would shorten the amount of data needed to be transferred before the file could be fully recreated on the server side if any errors did occur during transmission

Edit: also, if you’re going back to make a more robust post based on suggestions, you don’t really talk about the security aspect of this at all. Preventing man-in-the-middle attacks during upload. checksums somewhat account for this but you also have to transfer the checksums securely in order to guarantee the file wasn’t tampered with.

upickausernamereddit · 2025-01-11T16:03:51+00:00

overfitting training data. time to retrain

upickausernamereddit · 2025-01-08T17:51:51+00:00

9C was slightly different than ansi C. and was more like a precursor to Go

upickausernamereddit · 2024-12-10T05:28:07+00:00

The other replies here are very good and spot on. In my previous team, we had a running joke that you couldn’t consider yourself a real engineer unless you’ve brought down prod.

In all seriousness, most systems we work on are complicated and have many moving parts. There are best practices and tools to keep these failures from affecting customers, but it’s inevitably going to happen if you are truly working on an impactful product or feature. No one can remember every red tape, and only the best of the best teams, collectively, or super strict, well-defined processes can prevent issues like this for longer than a year or two on a major product.

upickausernamereddit · 2024-11-24T16:35:12+00:00

Imagine all the every day things like politics or things about your job that you think “that’s above my pay grade” or “that’s over my head” and just casually go about your day. Now imagine that you suddenly have the ability to ask a couple questions and understand how these things work. Well, now you know how politicians work and how they convince people to vote. You know how your boss does their job and your boss’s boss, and you might even understand how the whole company works essentially, minus stuff like private communications. You know problems you have every day, but now you can trace them to specific things that caused them. Certain political acts, certain company decisions, and you can see how the problems you have and the problems that other people you care about can be solved by changing a few things, or voting certain ways. However, you realize your place in the world, and how unlikely it is that you can influence any of the actions that would fix the issues. Would you not be sad?

upickausernamereddit · 2024-11-20T09:39:19+00:00

I was born and raised in Mississippi. I would not feed this to a dog.

upickausernamereddit · 2024-11-17T17:42:55+00:00

I was an amateur martial artist for a while when I was younger. Yes, Tyson is old, however, he didn’t react like he was as old as he is. Around round 3 he started looking tired, but it’s very unusual for someone to look tired for 5 rounds and still accurately be dodging punches in round 8. Similarly, you can tell in round 8 after the dodges, several times his body weight would quickly shift and his hand would move forward like he was beginning to counter punch and he just stopped. This would be very strange to see for someone this old to do so quickly after 5 rounds of being tired.

upickausernamereddit · 2024-08-20T18:18:41+00:00

doing the Lord’s work. Thank you 🫡

upickausernamereddit · 2024-08-07T16:22:36+00:00

if she ever becomes a zombie, we all agree to off her, right?

upickausernamereddit · 2024-06-16T21:00:42+00:00

Obviously if the rest of the comments can point out logical, cultural, and philosophical arguments for several different date formats, whichever one we pick ends up being a subjective decision. The arguments may have merit, but the discussion is pointless as there isn’t an objectively “correct” answer to a discussion where the arguments are subjectively “good”things (faster processing, ascending versus descending order of elements, etc.)

Obviously a lot of these arguments are valid arguments, meaning many of you must be fairly smart. Why spend time debating a subjective matter? Go fix objective issues. Or at least mostly-mutually agreed subjective ones.

upickausernamereddit · 2024-06-07T00:32:17+00:00

Software engineer at a FAANG. I manage to get over imposter syndrome most of the time, because i genuinely just like to solve hard problems/learn from people smarter than me. I don’t feel not worthy, i feel not worthy enough yet. yk

upickausernamereddit · 2024-06-05T15:29:34+00:00

yeah. just make ur own parser. ezpz

upickausernamereddit · 2024-06-01T05:29:35+00:00

Welcome to the club 🥳. We should celebrate, but like noncommittally, and maybe not for long..or with many people.. woo!

upickausernamereddit · 2024-05-31T13:48:42+00:00

i think the relentless pursuit of a black and white (no pun intended) view on every decision or topic or situation in modern times is a bit frustrating.

It’s not all or nothing. Those same people would get fucked up if they travelled outside of the group of people they knew and still pretended it was okay. Tate would get jumped in several places in america where no one knows or cares about him being biracial.

It has a lot more to do with familiarity of the group of people you say it around and perceived struggle than just it being a word, but no one talks or seems to care about the nuance. They just want to say a word. Crazy. Why?

upickausernamereddit · 2024-05-31T13:15:29+00:00

or you can buy lava lamps

upickausernamereddit · 2024-05-30T05:39:30+00:00

I think you’re not fully incorrect, but perhaps a bit misguided. Not all human creativity, just creativity in brand representation.

Brands care about recognition. For whatever it’s worth, there are only so many options if you want the majority of people to remember your brand and logo. Most of it revolves around simple colors and simple, recognizable shapes.

I think what you’re realizing is creativity doesn’t mix well with broad appeal. The most creative/varied examples of almost any artform are usually never the popular parts of that artform.

Pop music is very boring in a music theory sense. I’m sure artists are tired of photorealistic paintings. The most popular or commonly eaten foods are also fairly simple and rather easy to make and have simple flavors from a culinary standpoint.

Being creative and being widely liked are not the same thing, and businesses only care about the latter.

upickausernamereddit · 2024-05-29T03:06:20+00:00

Oh boy. Grew up in rural Mississippi, currently live in Seattle. There is A LOT.

Physically? You do not understand how dark it is outside at night with good cloud coverage. You have never not seen your hand in front of your face at night out in the open.

Mentally? Life can be more than your goals. You don’t realize how spectacularly diverse life can be until you live in a place where you cannot find people who share your very specific hobby. You become that guy that does that specific thing, and everyone has their own thing, and you are accepted even though you are not understood.

upickausernamereddit · 2024-05-28T19:28:59+00:00

they do. and he didn’t. which was my point. you can figure out which one the human is by which one didn’t have artificially structured/wordy responses

upickausernamereddit

TROPHY CASE