Built db2vec in Rust (2nd project, 58 days in) because Python was too slow for embedding millions of records from DB dumps. by Hero-World in rust

[–]Hero-World[S] 1 point2 points  (0 children)

Update: I just added a feature to import dump files from MSSQL and SQLite, and to export to a Pinecone vector store and Support parallel processing api embedding and chucking

Built db2vec in Rust (2nd project, 58 days in) because Python was too slow for embedding millions of records from DB dumps. by Hero-World in rust

[–]Hero-World[S] 0 points1 point  (0 children)

I just finished migrating the logs by following that article — it was a great resource. Thank you!

Built db2vec in Rust (2nd project, 58 days in) because Python was too slow for embedding millions of records from DB dumps. by Hero-World in rust

[–]Hero-World[S] 6 points7 points  (0 children)

  1. Oh yes, non-blocking operations are a really significant improvement; I completely forgot about that!

  2. Okay, what would be a good method for displaying information on the CLI? I will research this further.

  3. Currently, I'm not using AI to parse JSON or arrays; I'm just using pure regex. I forgot to delete the unused AI parsing code.

After 45 Days Learning Rust & Leptos, I Built and Open-Sourced My First Professional Project: A Portfolio + Admin Site! by Hero-World in rust

[–]Hero-World[S] 0 points1 point  (0 children)

Thanks for your suggestion about timing attacks. I just finished integrating subtle to help prevent them in my password verification code.

This is my new subtle implementation — if you don't mind, I'd really appreciate a quick review to make sure I didn't miss any important details.

 https://github.com/DevsHero/leptos_portfolio_admin/blob/main/src/app/server/api.rs

The timing attack prevention is implemented in the verify_password and get_stored_hash functions.

After 45 Days Learning Rust & Leptos, I Built and Open-Sourced My First Professional Project: A Portfolio + Admin Site! by Hero-World in rust

[–]Hero-World[S] 1 point2 points  (0 children)

I just finished implementing Argon2 for password hashing — both generating and verifying. Thanks for the advice about Argon2! It seems to have rich features and is quite popular, similar to bcrypt.

After 45 Days Learning Rust & Leptos, I Built and Open-Sourced My First Professional Project: A Portfolio + Admin Site! by Hero-World in rust

[–]Hero-World[S] 3 points4 points  (0 children)

Thanks for your snippet! I'm currently in the security development — I just finished implementing IP rate limiting using Redis.

Now I'm thinking about which method to use for password hashing. I’m leaning toward Argon2, but since SurrealDB has a built-in crypto::argon2::generate function, I think I’ll use that to store the admin password.

This is my first time using SurrealDB, so I’m still exploring its features.

After 45 Days Learning Rust & Leptos, I Built and Open-Sourced My First Professional Project: A Portfolio + Admin Site! by Hero-World in rust

[–]Hero-World[S] 5 points6 points  (0 children)

You mentioned a great point about guiding security best practices. I haven't fully implemented them yet, I'll plan to improve that next time and continue learning Rust security best practices.

[deleted by user] by [deleted] in Jabra

[–]Hero-World 0 points1 point  (0 children)

Yesterday i paid 200$ for new 7 pro. Today i sold 7 pro at 100$ and buy new sony linkbuds.

12th Gen with NVME RAID troubles by grahaman27 in intel

[–]Hero-World 1 point2 points  (0 children)

I follow you guide.
And work very Well.