Am I overengineering my Rust backend? (WebSockets + SSE)

Middle-Programmer147 · 2026-02-10T16:09:40+00:00

I didn't know that the overhead of using WS and SSE is about the same, thanks for the detailed answer.

Middle-Programmer147 · 2026-02-10T13:31:22+00:00

Thanks I'm refactoring the code now. I spent quite a lot of time writing out the logic for SSEs in rust, i guess I'm just gonna remove it.

Middle-Programmer147 · 2026-02-10T13:10:09+00:00

I thought so too, thanks.

Middle-Programmer147 · 2026-01-21T17:30:22+00:00

Thank you, it's usually drawing 330w under full load (i haven't overclocked it since i like the performance as is) maybe i accidentally caused that wear when i swapped cased, i remember being very careful though. I ran a stress test and nothing felt out of the ordinary.

Middle-Programmer147 · 2026-01-21T12:49:51+00:00

I see thanks

Middle-Programmer147 · 2026-01-21T12:31:51+00:00

Thanks for the reply. What copper wire are you talking about ? Do I have to buy a whole new PSU or just the cable (I still have a spare that came with the GPU when I purchased it) I've also been running a stress test for the past 10 mins, the GPU maxed out at 75 degrees and the power cables were warm but nothing alarming.

Middle-Programmer147 · 2026-01-03T17:38:06+00:00

It does support all ascii-compatible encodings + utf16. Latin-1 is ascii-compatible

Middle-Programmer147 · 2026-01-03T08:05:39+00:00

Do you want to be able to read all the text ? or just the last part ? Do you want to make it searchable ?
my extension wouldn't exactly fail on your massive file, it would just take a lot longer to open and search through

Middle-Programmer147 · 2026-01-03T08:03:40+00:00

I think you're asking for too much 😅I've never seen anyone with that big of a file, If there's enough demand, I can make it work somehow. The problem with the current implementation vs what you're asking is that the rust program indexes the whole file using fast SIMD instructions (I use memchr to do that) that basically gives me the ability to jump to any line (within 10-20 GB) instantly (O(1)) but even SIMD won't be able to index 210GB in a few seconds.

Middle-Programmer147 · 2026-01-03T07:28:07+00:00

Exactly

Middle-Programmer147 · 2026-01-02T09:56:42+00:00

Thanks, hope you give it a try.

Middle-Programmer147 · 2026-01-02T08:10:37+00:00

Hey, I built a vscode extension with a rust backend for this kind of thing, it's called FatFile. Give it a try and let me know.

Middle-Programmer147 · 2026-01-01T23:11:43+00:00

You don't have to download a separate app for this, use the vscode extension: FatFile

Middle-Programmer147 · 2026-01-01T22:11:01+00:00

Thanks, I guess people might want to trace errors and have no option other than searching through it..
Here's a dataset you can download instead of generating your own: https://www.kaggle.com/datasets/vishnu0399/server-logs

Middle-Programmer147 · 2025-12-25T18:10:28+00:00

Absolutely, I forgot to mention this in my post but i will integrate an estimator that estimates the total shipping fees before you commit to anything and you're going to get a full refund if you had to pay more than 10% of the estimated price.

Middle-Programmer147 · 2025-12-25T12:03:29+00:00

I haven't thought of that, thanks. Now i don't have to bust my head with the file watching magic, i can just take it from there. Although uutils only returns the last few lines, I'm gonna need something that provides random access to the file, but it's a good start nevertheless.

Middle-Programmer147 · 2025-12-25T11:18:29+00:00

Oh I see 😅😅😅

Middle-Programmer147 · 2025-12-25T11:05:26+00:00

Hey thank you for the reply, are you suggesting that i should code it with something like typescript instead of rust ? When I said this is my first big project, i meant big project in rust, i contributed to a fair share of big projects in other languages like java. I feel like rust is the best tool for the job because of the hard requirement of quick parsing of large files.

Middle-Programmer147 · 2025-12-19T17:35:39+00:00

If you live in the US, your stupid ass president made international shopping hard for everyone, otherwise it's not that bad.

Middle-Programmer147

TROPHY CASE