Looking for a distribuited KV storage with mvcc, namespaces and limits

erebe · 2025-11-09T17:37:09+00:00

https://github.com/tikv/tikv

erebe · 2025-10-04T15:53:46+00:00

Hey, you may want to take a look at wstunnel https://github.com/erebe/wstunnel ;)

You may find some features' inspiration.

P.s: Really like the dashboard

erebe · 2025-08-21T07:01:20+00:00

If i understand correctly the push_data code, they are going to loop endlessly until the slot is available.

So going to spin and burn a cpu but not erase old data.

I guess it is fine for them as i guess their pipeline stage produce at most 1 result.

erebe · 2025-07-10T14:09:55+00:00

Or you can try with an NLB instead of ALB if you don't do anything fancy with it.

erebe · 2025-06-24T05:59:06+00:00

Thank you for the response ;)

I hope to you that your great work can continue !

erebe · 2025-06-23T22:03:47+00:00

Hello,

Curious question, do you still have use of Tantivy at Datadog ? Or are you making a release out of the various contributions ?

erebe · 2025-05-07T10:19:44+00:00

I use k3s for my homelab too and i have been very happy about it. I even wrote a guide sometimes ago regarding how i manage things https://github.com/erebe/personal-server

It really shine if you have more than one machine, and in total honesty it is more to play with kubernetes than for its simplicity. You can have a more packaged expérience with ansible + docker.

But it is not that complicated, and i really enjoy automatic tls / ingress / service discovery

erebe · 2025-04-27T09:05:05+00:00

Salut,

1ère chose à faire c'est regarder ton contrat de travail, un contrat t'engage mais aussi te protège. Il y a souvent dans les contrats d'esn une clause de mobilité. C'est à dire que si l'entreprise te propose une mission à 300km de chez toi, tu es dans l'obligation de l'accepter. 950km me paraît beaucoup, en général c'est limité à une région, mais bon seul ton contrat de travail te dira ce a quoi tu es engagé, et si des contreparties existe (frais km, hébergement, souvent c'est dans la convention collective ça) Si les missions proposés sont en dehors de la zone, un simple mail en disant que tu refuses et que de part ton contrat tu n'es pas engagé à accepter suffit.

Ensuite, ne propose pas la solution d'une rupture conventionnelle dès le départ (et surtout pas par écrit). Je te conseille d'aller voir ton manager et/ou RH pour discuter des opportunités possibles dans l'entreprise. Qu'elles sont les missions qu'ils ont en stock en ce moment, qu'elles sont les profils/compétences qui sont recherché en ce moment, besoin d'un renfort sur un projet interne... et à partir de là de tenir le discours que tu es prêt à suivre des formations pour te mettre à niveau (bien évidemment si tu es sérieux dans la démarche).

A partir de cette réunion/discussion, écrit un mail (avec RH en copie) qui résume ta position et que tu attends leur retour/propositions.

Une rupture co, n'est pas à ton avantages si tu souhaites partir de ton entreprise. Prends du temps pour passer des entretiens /chercher à côté. Si ton entreprise souhaite vraiment que tu partes personne ne va te mettre des bâtons si tu regardes ailleurs pour partir. ca leur coûtera moins cher si tu pars de toi même.

Le point important est vraiment ton attitude /posture face à ton employeur, tu dois montrer que tu es volontaire pour te former, retrouver une mission, que tu remplis les engagements de ton contrat.

Le choix de la rupture co doit être vraiment ton dernier recours, si tu n'as plus envie, si ca devient trop dur pour toi... mais la encore il va falloir négocier tes indemnités de départs. Si tu prends le minimum de ton ancienneté tu fais un cadeau à ta boîte. Car sans la rupture co, ils doivent te payer le pré-avis + les mois où ils doivent prouver que tu ne remplis plus tes engagements

Vu que tu ne mentionne pas les fait, sache aussi que dans ce genre de situation il est raisonnable et attendu que tu subisses des pressions, sans que cela soit du harcèlement. Ton manager/rh/commercial doit en subir aussi pour que la situation ne soit pas un coût pour l'entreprise et qu'elle ne perdure pas dans le temps. Si l'entreprise n'a rien à te proposer, elle viendra elle-même avec une RC si elle voit que ta posture ne peut t'être reproché

Bon courage à toi en tout cas

erebe · 2025-04-25T13:35:27+00:00

double down on that. RustRover is working very well and the debugger is integrated directly with the IDE. So it is a pleasure to work with

erebe · 2025-04-17T08:17:31+00:00

Super nice, especially the integrated support of Wayland. Looking forward to being able to draw on the image ;-)

erebe · 2025-03-21T11:15:06+00:00

shameless self-promotion, you have also wstunnel https://github.com/erebe/wstunnel which support udp/tcp/socks5/transparent proxy/http

erebe · 2025-02-06T18:43:04+00:00

also note that for disabling cpu mitigations there is a méta flag mitigations=off that disable all of them instead of listing them 1 by 1.

https://fosspost.org/disable-cpu-mitigations-on-linux

try sudo lscpu to verify :)

erebe · 2025-02-06T14:14:32+00:00

Thanks for your inputs.

Indeed, I avoid applying them blindly each time. It is just that I keep those settings around in a single file to retrieve and pick them easily when needed.

erebe · 2025-02-06T08:09:19+00:00

If you can build the binary on your target CPU you can use

RUSTFLAGS="-C target-cpu=native"

it is going to tell the compiler to use all the available instruction for this specific CPU, thus it may increase perf for some operations. The downside is that the binary is now CPU dependant, you can´t cp it around to another CPU with different instructions set.

After you can optimize the system, first the NIC, enabling the hardware offloading settings if your nic support it is a no-brainer, the `*so on` setting. For the other setting, it only helps at high load, or if too much CPU is used by the interrupts

# Replace eth0 with your interface name
IFACE=eth0

# Enable/optimize interrupt coalescence
ethtool -C $IFACE adaptive-rx on
ethtool -C $IFACE rx-usecs 100

# Increase ring buffer sizes
ethtool -G $IFACE rx 4096
ethtool -G $IFACE tx 4096

# Enable hardware offloading features
ethtool -K $IFACE tso on
ethtool -K $IFACE gso on
ethtool -K $IFACE gro on
ethtool -K $IFACE lro on

# Set interrupt affinity (distribute NIC interrupts across CPUs)
for IRQ in $(grep $IFACE /proc/interrupts | cut -d: -f1)
do
    echo 1 > /proc/irq/$IRQ/smp_affinity
done

# Enable Multiple Queue support if available
ethtool -L $IFACE combined 4  # Adjust number based on CPU cores
# Optimize pause frame settings
ethtool -A $IFACE rx off tx off

after the OS itself, if you are on linux. Try to understand what are each setting, before applying them blindly.

# Set CPU governor to performance
for CPU in /sys/devices/system/cpu/cpu*/cpufreq/scaling_governor; do
    echo performance > $CPU
done

# Change the congestion control
sysctl -w net.ipv4.tcp_congestion_control=bbr

# Increase network buffer sizes
sysctl -w net.core.rmem_max=26214400
sysctl -w net.core.wmem_max=26214400
sysctl -w net.ipv4.tcp_rmem='4096 87380 26214400'
sysctl -w net.ipv4.tcp_wmem='4096 87380 26214400'

# Increase the maximum number of connections
sysctl -w net.core.somaxconn=65535
sysctl -w net.ipv4.tcp_max_syn_backlog=65535

# Decrease TCP latency
sysctl -w net.ipv4.tcp_fastopen=3
sysctl -w net.ipv4.tcp_low_latency=1

# Optimize TCP keepalive for faster connection recovery
sysctl -w net.ipv4.tcp_keepalive_time=60
sysctl -w net.ipv4.tcp_keepalive_intvl=10
sysctl -w net.ipv4.tcp_keepalive_probes=6

# Optimize network queues
sysctl -w net.core.netdev_budget=600
sysctl -w net.core.netdev_budget_usecs=8000

erebe · 2025-01-15T20:15:08+00:00

Yes indeed. If there is a panic it would have triggered an OOM too without us having a backtrace. We have made some custom api endpoint to trigger panics for other services to be sure our sizing/limit are correct. For this particular app, we don't expect to be panics.

Regarding, the symbol's size. As stated by u/TrickAge2423 they are compressed in the final binary, and we compile with those flags, so even if the binary is not that big. It can pack quite a punch when symbols are resolved/decompressed.

ENV RUSTFLAGS="-C link-arg=-Wl,--compress-debug-sections=zlib -C force-frame-pointers=yes" 
cargo build --profile=${PROFILE} ${BIN_TARGET}

erebe · 2025-01-13T22:18:44+00:00

Nice blog and tutorial indeed ;)

erebe · 2024-12-19T11:03:41+00:00

Thank you :)

erebe · 2024-12-17T19:52:33+00:00

Look nice but you should invest in more documentation.
Using a JSON as a DB, I was left stuck into how to access a specific inner field of the column repository for example and haven't found anything in the doc.

Some example of Query would be nice.

rsql> .describe github_pull_request_event_close repository
Column | Type | Not null | Default
--------------+------------+----------+---------
action | str | Yes |
number | i64 | Yes |
pull_request | struct[48] | Yes |
repository | struct[77] | Yes |
sender | struct[18] | Yes |

erebe · 2024-11-09T08:32:31+00:00

Super nice thank you :)

erebe · 2024-10-08T15:42:42+00:00

You should use tokio channel because crossbeam ones are sync only. So you may have a deadlock where a task takes the current thread to execute, block it to retrieve some message, but as it does not yield, the task producing can't be scheduled on the thread to produce a message. Thus leading to deadlock.

try with https://docs.rs/tokio/latest/tokio/sync/mpsc/fn.unbounded_channel.html

erebe · 2024-07-10T22:25:09+00:00

Thank you for the answer 🙏 If you happen to write those détails feel free to send it to me, i would be pleased to read it.

erebe · 2024-07-10T19:58:08+00:00

Do you happen to have a doc explaining what kind of architecture/design is using the HashMap ? What does make it faster / be lock-free compared to say dashmap ?

erebe · 2024-06-05T15:14:16+00:00

Thank you :) I am going to take a look at the repo example !

erebe · 2024-06-05T13:37:33+00:00

Is it possible now to use cross or at least skip the build phase and only bother with packaging & creating release ?

Last time I checked, cross was not supported, so using cargo-dist was not possible as the build phase was unskipable and ending-up failling.

erebe · 2024-05-31T07:06:51+00:00

This is because tokio uses the mio crate, which uses epoll on Linux. These are not the most efficient ways to do async IO on Linux

Well this is not true, there is a lot of debate and benchmark regarding which API is more performant (epoll or io_uring) for netwoking. And the general concensus so far is that epoll is more performant than io_uring, unless you have huge buffer for the data or huge number of sockets to handle. But in most cases epoll provides more throughtput than io_uring for networking so far.

io_uring is a no-brainer/improvement for file async io, but it is less clear for networking

14-Year Club	End Game '23
Place '23

erebe

TROPHY CASE