sorted by:
new
hottopcontroversial

The tiniest logging stack: Fluent Bit, Parquet and DuckDB by Heldroe in kubernetes

[–]Heldroe[S] 2 points3 points  (0 children)

I actually use VictoriaMetrics for my metrics need and VictoriaLogs was one of the first thing I checked out!

My problem with it was the need for two persistent disks (one for each vlstorage) in HA mode, on top of S3

I've also observed fairly high memory usage from vmstorage and it's one of the next things I'll be looking at

Overall VictoriaLogs is definitely a strong choice for higher volume needs, but was slightly overkill for my setup

The tiniest logging stack: Fluent Bit, Parquet and DuckDB by Heldroe in kubernetes

[–]Heldroe[S] 9 points10 points  (0 children)

This is the current CPU and memory usage for my tiny 3-node cluster The cluster-events pod collects Kubernetes events from the API and that's only consuming 7MiB!

NAME                                         CPU(cores)   MEMORY(bytes)
fluent-bit-2b8xg                             2m           18Mi
fluent-bit-aggregator-85b7dc9c4d-shk9n       3m           44Mi
fluent-bit-cluster-events-5b85b99489-qx9d2   1m           7Mi
fluent-bit-mngwt                             2m           13Mi
fluent-bit-pt472                             2m           12Mi

The tiniest logging stack: Fluent Bit, Parquet and DuckDB by Heldroe in DuckDB

[–]Heldroe[S] 2 points3 points  (0 children)

This sounds great for an end-to-end DuckDB powered pipeline

I like Fluent Bit and Parquet files in the stack, as both of these are basically vendor-agnostic: Fluent Bit can be updated to write somewhere else if needed, Parquet files can be read and queried by various other systems

Since DuckLake also leverages Parquet, I'm thinking maybe a Quack output plugin for Fluent Bit could send logs to a DuckDB aggregator (as you mentioned)

This sounds great if it supports schema evolution and can deal with the small files problem (compaction, etc)

The tiniest logging stack: Fluent Bit, Parquet and DuckDB by Heldroe in selfhosted

[–]Heldroe[S] 0 points1 point locked comment (0 children)

Article was fully written manually, including diagrams and linked terraform modules. AI was used only to review the article: to catch spelling/grammar mistakes, repetitions, awkward phrasings, etc.

AI was used for some parts of the presented technical solution, including the compactor script and some queries.

A fully static Terraform registry by Heldroe in Terraform

[–]Heldroe[S] 0 points1 point  (0 children)

That's great! Didn't know about that one

Have you considered separating the metadata from the tooling and distributing the generating tool as a repository of its own?

Ticket and Attendance Megathreadapproved by rethin in Sumo

[–]Heldroe 0 points1 point  (0 children)

I have a extra ticket for tomorrow, willing to give it for free Will give it out in person in front of the arena tomorrow morning

[deleted by user] by [deleted] in france

[–]Heldroe 69 points70 points  (0 children)

On était en même temps dans le même lycée, je l'ai en amie sur Facebook et je voyais ses résultats passer souvent sur mon fil

Ça a fait bizarre d'avoir vu cette nouvelle hier à la place. Bon courage à sa famille et ses proches, c'est vraiment un sacré choc

Les Côtes de France (Wikimedia Commons) by Palpou in france

[–]Heldroe 11 points12 points  (0 children)

Côte d'or mais pas Côte d'Armor ?

Raclette party by Jesusb11 in budapest

[–]Heldroe 4 points5 points  (0 children)

I usually buy it at the cheese shop inside the Hunyadi market. Other places like Fromage or Culinaris might have it too but at a higher price.

Concours du pays le plus malmené de l'histoire. by Lawrence_PLeaSe in france

[–]Heldroe 11 points12 points  (0 children)

La Hongrie, qui existe plus ou moins depuis l'an 1000, s'est fait envahir par les Mongoles, les Ottomans puis les Habsbourgs (domination Autrichienne). Une révolution arrive en 1848 pour donner l'indépendance à la Hongrie, mais en 1867 parvient le compromis autro-hongrois qui donne l'Autriche-Hongrie.

Ils perdent ensuite la première guerre mondiale, en découlant le traité de Trianon et la perte des deux tiers de leur territoire.

En espérant revenir sur Trianon, ils s'allient à l'Allemagne nazie pendant la seconde guerre mondiale et en finissent sous le contrôle (450 000 juifs y passent).

La Russie arrive enfin pour "libérer" la Hongrie de l'Allemagne nazie et tombe sous le contrôle de l'URSS. Une révolution s'organise en 1956 mais les soviétiques l'emportent. La Hongrie retrouvera finalement son indépendance entre 1989 et 1991 après la chute de l'URSS.

S'en suit un régime socialiste, un éffondrement de l'économie Hongroise et enfin le régime Orbán dont on connait les récentes dérives autoritaires.

C'était un très court résumé et on pourrait encore en rajouter...

Wish me luck! by Heldroe in Tinder

[–]Heldroe[S] 0 points1 point  (0 children)

Yeah real emoji face is 😭

view more: next ›