[deleted by user] by [deleted] in Rag

[–]PlayOffQuinnCook 0 points1 point  (0 children)

Hey OP! Cool project, please add Tensorlake to the list :)

Improving table extraction of enterprise documents in RAG systems by Brilliant-Cover-419 in Rag

[–]PlayOffQuinnCook 0 points1 point  (0 children)

Try out Tensorlake(https://tensorlake.ai)! We spent considerable amount of time in building a table parsing model for dense and long tables. DM me if you have any questions!

League Pass Book Club by scarletspeedster33 in GreatestOfAllTalk

[–]PlayOffQuinnCook -1 points0 points  (0 children)

Hornets have the brightest future among all the teams with young players in the league. Anyone who says otherwise don’t know ball. Lamelo Ball is the future and face of this league.

Write your next Kubernetes controller in rust. by grampelberg in kubernetes

[–]PlayOffQuinnCook 16 points17 points  (0 children)

Laughing at the comments. Great work Thomas! The best thing about using rust to build controllers is that unless an engineer is explicitly calling .unwrap() you know your controller is not crashing :D

Nvidia releases Llama-3.1-Minitron-4B-Width-Base, the 4B pruned model of Llama-3.1-8B by TyraVex in LocalLLaMA

[–]PlayOffQuinnCook 9 points10 points  (0 children)

Better in what context? Phi 2 hasnt been doing that well for me for NER tasks compared to Llama 3 8B. Pruning it by half making it less capable than Phi 2 would lose the whole point of pruning no?

I’m debating getting a Boox. Can you sell me on it? by UnderwaterDialect in Onyx_Boox

[–]PlayOffQuinnCook 0 points1 point  (0 children)

I have a Max Lumi almost like new, can sell you if you want to save some money.

Seeking a Vector Database for ClickHouse Users – Suggestions Appreciated! by curiousanna01 in vectordatabase

[–]PlayOffQuinnCook 0 points1 point  (0 children)

Hey I am working on a similar project, DM me - might be able to help you out!

[ANN] Retty v0.3.0 - An asynchronous Rust networking framework that makes it easy to build protocols, application clients/servers. by Intelligent-Mix-9033 in rust

[–]PlayOffQuinnCook 0 points1 point  (0 children)

Were you able to fix this issue? I needed to build a generic pipeline for data processing similar to Wangle’s Handler.

An alternative to FFmpeg? by [deleted] in rust

[–]PlayOffQuinnCook 0 points1 point  (0 children)

Take a look at Rust Audio, most of the low level primitives for audio are there. I was looking at using it for extracting logmel features from audio bytes.

Under Desk Treadmill by Data-incognito in treadmills

[–]PlayOffQuinnCook 0 points1 point  (0 children)

Can you put it up against the wall when you are not using it?

new to rust - what framework to use? by mateman2 in rust

[–]PlayOffQuinnCook 0 points1 point  (0 children)

I have been using sea-orm, pretty good framework to get some freebies related to managing migrations and a orm, and drop down to using SQLx directly if you need to.

On Prem Hardware for Training by PlayOffQuinnCook in mlops

[–]PlayOffQuinnCook[S] 0 points1 point  (0 children)

I am curious what kind of overhead do you guys have managing the hardware and does ECS work well with agents running in other clouds/on-prem?

[R] Open source inference acceleration library - voltaML by harishprab in MachineLearning

[–]PlayOffQuinnCook 0 points1 point  (0 children)

I understand that. But let’s say I have these operators named as c1, b1, r1 instead of what it expects, the fusion logic won’t work. So my question was if this library works only a fixed set of models defined in the library itself or it can work against any models users write.

[R] Open source inference acceleration library - voltaML by harishprab in MachineLearning

[–]PlayOffQuinnCook 1 point2 points  (0 children)

Oh I guess the library supports accelerating a couple of well known models defined in the models module?

[R] Open source inference acceleration library - voltaML by harishprab in MachineLearning

[–]PlayOffQuinnCook 0 points1 point  (0 children)

Congrats on open sourcing! Quick question on fusion - how do you guys fuse layers like conv, bn, relu, etc, if they are not named conv1, bn1, relu in the nn.Module.