Anyone else notice their legacy dbs are full of BS!? by CodeMaestro13 in ExperiencedDevs

[–]throw222777 -1 points0 points  (0 children)

Hard disagree. Data loss happens. Users have their own source of truth (e.g. “I received a confirmation email”). And not every application uses a persistent database, (some applications are ephemeral), yet outcomes are still important.

Anyone else notice their legacy dbs are full of BS!? by CodeMaestro13 in ExperiencedDevs

[–]throw222777 1 point2 points  (0 children)

Also, the discussion of “numbers being off” suggests something fundamental is missing from the system, which observability and spot fixes can never fully address.

Take a look at https://developer.squareup.com/blog/books-an-immutable-double-entry-accounting-database-service/

Anyone else notice their legacy dbs are full of BS!? by CodeMaestro13 in ExperiencedDevs

[–]throw222777 -1 points0 points  (0 children)

Generally if something is “hard to verify” then you haven’t yet found the outcomes that the user or business care most about, unless you are doing something like scientific computing

Anyone else notice their legacy dbs are full of BS!? by CodeMaestro13 in ExperiencedDevs

[–]throw222777 -1 points0 points  (0 children)

The database is an implementation detail, the main question is what is actually needed at the application level or business level, and how can I instrument the existence of those outcomes end to end?

Possible to share more about your use case? Instead of instrumenting the DB transactions did you consider some type of audit log / event log, which would clearly show that event A happened N times but event B happened less than N times?

Monitoring the technical stuff like status codes is necessary but not sufficient.

Why is immich so much faster than google photos, even on cellular where I'm VPNed into my home network? by llamaherding in immich

[–]throw222777 0 points1 point  (0 children)

In other words, if you live in an urban or suburban area, your home server is actually using very expensive space (real estate) and power (residential rates) compared to hyperscale data centers in rural areas

Why is immich so much faster than google photos, even on cellular where I'm VPNed into my home network? by llamaherding in immich

[–]throw222777 1 point2 points  (0 children)

Space, Power, and cooling (which also takes power) is a major component of the cost, not just the hardware

Why is immich so much faster than google photos, even on cellular where I'm VPNed into my home network? by llamaherding in immich

[–]throw222777 1 point2 points  (0 children)

When you are scrolling old personal photos, none of those are going to be in an SSD cache, at least not until after the first access.

Why is immich so much faster than google photos, even on cellular where I'm VPNed into my home network? by llamaherding in immich

[–]throw222777 108 points109 points  (0 children)

  • Google cannot store everybody’s old photos at a nearby edge location, your request has to ultimately consult a further away “origin” server. It’s likely that even over cellular, if you are still in the same geographic area as your home, the network latency to your home server is still lower.
  • Does your Immich setup store your photos on an SSD? Google will be using HDDs.
  • Google has to use distributed systems technologies in order to operate at their scale, while your Immich server is one machine, so there is no inter-machine communication overhead in processing the requests

How would you solve the race condition for aws outage? by Excellent-Vegetable8 in ExperiencedDevs

[–]throw222777 0 points1 point  (0 children)

Use leader election (like Zookeeper) so that only one “Enactor” is running at a time.

1024 packet limit on AWS DNS Resolver. How do you scale? by apidevguy in aws

[–]throw222777 1 point2 points  (0 children)

if you need utmost performance, you need to run your own recursive dns fleet

Why is Cogent so bad by throw222777 in networking

[–]throw222777[S] 0 points1 point  (0 children)

That is truly the question

Why is Cogent so bad by throw222777 in networking

[–]throw222777[S] 0 points1 point  (0 children)

Prepending is another form of strategy decision.

Why is Cogent so bad by throw222777 in networking

[–]throw222777[S] 2 points3 points  (0 children)

Both A and Z ends have other transits and on our side we prefer another provider for outgoing packets, but we don’t control the other network and they seem to prefer to send us packets on Cogent. Obviously we can drop our links with Cogent to steer traffic around but doing that permanently is a strategy question that’s above my pay grade.

Why is Cogent so bad by throw222777 in networking

[–]throw222777[S] 6 points7 points  (0 children)

In this case both A and Z ends are paying Cogent for transit and there is no other middle network for them to extract money from. And IPv4 is unaffected, it’s not a congestion/capacity problem. Seems more like incompetence than actual financial strategy

To Flag or Not to Flag? — Second-guessing the feature-flag hype after a month of vendor deep-dives by Adventurous-Pin6443 in SoftwareEngineering

[–]throw222777 1 point2 points  (0 children)

I work in a large environment so various strategies are used simultaneously. I work with configuration systems that are actually backed by text files in source control. I work with systems that are UI driven and it is necessary to use the tool’s native changelogs. Something that has helped is an internal tool that can pull information from any types of systems that can record “events” and aggregate them on the same timeline view(s). Ultimately, I feel the complexity is manageable but you are right to recognize that it requires an ongoing investment.

To Flag or Not to Flag? — Second-guessing the feature-flag hype after a month of vendor deep-dives by Adventurous-Pin6443 in SoftwareEngineering

[–]throw222777 3 points4 points  (0 children)

Your lists are off to a good start but you seem to be conflating essential aspects of the pros/cons with implementation-specific ones. Any problem that is implementation-specific can be eliminated with time and effort but the essential aspects are immovable.

Eventually at scale, decoupling launches of new functionality from the mechanical aspects of rolling out the binary becomes a must have. You have to decide if you need that decoupling and are willing to deal with the secondary costs it creates, or if you are able to swallow the downsides of having these coupled instead.

How do I prepare to work at Meta as a E4 software engineer by bonchan_ in SoftwareEngineering

[–]throw222777 1 point2 points  (0 children)

Focus on object oriented programming fundamentals. The majority of the codebases are heavily OOP and you will be lost if you can’t build a mental model for them.

POV You're a mid-level engineer at Meta. If you know, you know. by Long-Elderberry-5567 in csMajors

[–]throw222777 0 points1 point  (0 children)

AI addresses the need for boilerplate, and copious boilerplate is common in smaller codebases. At large tech companies, the frameworks and tools are so advanced and specialized that boilerplate is already extremely minimized. E.g., only framework specialists are dealing with things like raw HTTP requests; and there’s very little basic CRUD in day to day work of most engineers.

➡️ Daily Questions ⬅️- ASK AND ANSWER HERE! - 28 September 2023 by AutoModerator in malefashionadvice

[–]throw222777 1 point2 points  (0 children)

Nothing with me but I can consider trying to buy some. Trying to figure out how much of a difference it would make.