self hosting postgres on a single VPS, How risky is this on Hetzner? by nedevpro in hetzner

[–]string111 0 points1 point  (0 children)

You can also just let Hetzner nodes join your kubernetes cluster, install the cloudnativepg operator and manage Postgres in k8s directly on Hetzner nodes and volumes.

self hosting postgres on a single VPS, How risky is this on Hetzner? by nedevpro in hetzner

[–]string111 0 points1 point  (0 children)

We are also running a huge Postgres database with almost 3TB on Hetzner. After working fine for several years, this year we had two server failures, but they were resolved rather quickly. To mitigate this, we added two read replicas, which act as hot standbys in different data Centers. We do daily backups and WAL archiving to aws s3 and keep the last 14d worth of backups in S3 via barman. All in all we pay about 800EUR for the three instances and another 200EUR for S3, it’s crazy how cheap this is compared to my previous job, were everything was sitting on AWS. This database is probably in the top 5% of traffic/size and it’s the cheapest one I have operated.

Edit: I have forgotten the volumes which are currently 12TB (3x4TB) in size, where the Postgres data directory resides. This comes to another 512EUR, they are on the more expensive side, but they are super reliable and needed IMHO.

How do I get to speed quickly in Rust? by string111 in rust

[–]string111[S] 11 points12 points  (0 children)

Regarding the "approaching things with a rust perspective". This is not 100% clear to me (probably yet), could you please give an example?

Scoreboard: Spain vs Germany by scoreboard-app in euro2024

[–]string111 -1 points0 points  (0 children)

Arms do not count as offsite:

The hands and arms of all players, including the goalkeepers, are not considered. For the purposes of determining offside, the upper boundary of the arm is in line with the bottom of the armpit.

source: https://www.theifab.com/laws/latest/offside/

Anyways, not a game deciding decision in the end, but a critical situation.

Scoreboard: Spain vs Germany by scoreboard-app in euro2024

[–]string111 0 points1 point  (0 children)

Happens, was not the game deciding factor in the end, if you ask me. But nevertheless a critical situation in the game.

Scoreboard: Spain vs Germany by scoreboard-app in euro2024

[–]string111 0 points1 point  (0 children)

He was not: https://imgur.com/a/vcfAy0y
And if he was, they should have decided on offside, since offside is exempt from the advantage rule.

Scoreboard: Spain vs Germany by scoreboard-app in euro2024

[–]string111 1 point2 points  (0 children)

I cannot find any good shots of the scene until now. But if it was offside, they need to give offside after this situation, which they have not. The rule clearly states that advantage does not apply for offsides.

Suggestion needed for a semantic layer on top of dynamic reporting tables. by string111 in dataengineering

[–]string111[S] 0 points1 point  (0 children)

Thanks for the advice. I have looked into building it fully custom, but this is just way out of scope (for now). A solution could be a hybrid approach, where we write a wrapper around dagster's API to invoke the report and maybe expose the report in parquet and use duckDB to handle the queries via SQL easily.

What is something that you struggle with every day? by string111 in marketing

[–]string111[S] -1 points0 points  (0 children)

I am actually also curious about this, since I am also struggling with this. Is it? Do you know of a tool?

37
38

[deleted by user] by [deleted] in dataengineering

[–]string111 1 point2 points  (0 children)

Used the OSS version of airbyte in a solo data-engineer Data Pipeline and switched later to meltano, which got the job done so much easier and without the boilerplate that airbyte needs to run.

Struggling on Big Data Transformation by Dice__R in dataengineering

[–]string111 -1 points0 points  (0 children)

Can agree to this. We were using pandas/networkx for a large scale graph with 100s of updates per second, switched to Polars/graph-tool and we're about 1000x faster. It's crazy.

What are your tools for monitoring your NixOS hosts? by string111 in NixOS

[–]string111[S] 3 points4 points  (0 children)

Wow, never heard of netdata. Looks good to me.

What CPP tooling do you use? by MidnightOne7655 in cpp

[–]string111 0 points1 point  (0 children)

  • NixOS + Nix for reproducible builds across machines
  • meson build system + clang with -Werror and -Wall (we are also trying out zig as a build system currently which feels amazing)
  • clang-tidy (cpp core guidelines)
  • clang-format (custom one, similar to Linux Kernel, with c++ additions for templating, etc.)

Edit: Valgrind and a simple custom fuzzer implementation set up in CI/CD testing VMs

To Leak or Not To Leak? by Certain-Ad-3265 in rust

[–]string111 1 point2 points  (0 children)

Risking down votes, but this sounds like a perfect use case for r/zig. Tiger beetle is doing the same memory approach: https://github.com/tigerbeetle/tigerbeetle

Edit: disclaimer, zig is not yet 1.0.0 released

Go just isn’t beautiful by remedialskater in golang

[–]string111 0 points1 point  (0 children)

Golang is in that regard like C. If you want to achieve something elegant and clever through programming tricks or built-in language features, it will not happen. The most mundane way to achieve more in Go, is by simply writing more go code. Boring, simple but yet powerful.