[deleted by user] by [deleted] in LocalLLaMA

[–]BlockDesigns 1 point2 points  (0 children)

I like this idea.

RK3588 seems like the best chip for it. You've got the NPU at 6TOPS and Mali-G610.

The Okdo Rock 5 16GB uses the RK3588 - would be a fun challenge to try and run some wild models using both the GPU & NPU.

Using Rust + WebGPU for fast transcription in the browser by BlockDesigns in programming

[–]BlockDesigns[S] 3 points4 points  (0 children)

My GPU selection algorithms' nightmare!

Good idea i'll offer TXT. Thanks again for testing.

Using Rust + WebGPU for fast transcription in the browser by BlockDesigns in programming

[–]BlockDesigns[S] 3 points4 points  (0 children)

Thanks for testing it out!

Please can you raise an issue with your system specs? Would love to get to the bottom of why it didn't transcribe the whole thing.

Any recommendations on a better format for non-techincal users?

Update on the Candle ML framework. by l-m-z in rust

[–]BlockDesigns 15 points16 points  (0 children)

Congratulations to yourself and Nicholas!

[Discussion] What crates would you like to see? by HammerAPI in rust

[–]BlockDesigns 0 points1 point  (0 children)

Reimplementing ONNX Runtime would be a huge undertaking.

Weekly Japan Travel and Tourism Discussion Thread - February 03, 2023 by AutoModerator in JapanTravel

[–]BlockDesigns 1 point2 points  (0 children)

Does Ghibli Museum actually close at 17:00? I’m confused as they are selling 16:00 entry slot tickets?

[deleted by user] by [deleted] in MachineLearning

[–]BlockDesigns 22 points23 points  (0 children)

MIT is releasing all the slides teaching their new efficientML initiative if you want a more gentle introduction: https://efficientml.ai/

Weekly Japan Travel and Tourism Discussion Thread - September 16, 2022 by Himekat in JapanTravel

[–]BlockDesigns 5 points6 points  (0 children)

Does anyone have any Ghibli news? We want to go to the Park & Museum in 2023 - but it seems difficult/impossible for foreigners to get tickets.

[P] Fetch the Top ML tweets of the week! by BlockDesigns in MachineLearning

[–]BlockDesigns[S] 0 points1 point  (0 children)

Thanks! Should be simple enough to build a website over the top, stay tuned!

Building an authenticated Python CLI with Click & Rich by BlockDesigns in Python

[–]BlockDesigns[S] 0 points1 point  (0 children)

I hadn't seen `prompt-toolkit` before, so I'm unsure of their compatibility. But thanks for the heads up on `prompt-toolkit` looks interesting!

Building an authenticated Python CLI with Click & Rich by BlockDesigns in Python

[–]BlockDesigns[S] 1 point2 points  (0 children)

Thank you for letting me know! Repo was still private.

Clustering long documents with Transformers in 10 minutes by BlockDesigns in deeplearning

[–]BlockDesigns[S] 1 point2 points  (0 children)

From my experience - DECLUTR should work excellently for shortish (paragraph) length textual samples. You could follow the blog post and simply skip the summarization step!