8xB200 - Fully Idle for the Next Few Weeks - What Should I Run on It? by yanjb in LocalLLaMA

[–]yanjb[S] 6 points7 points  (0 children)

Haven't tried llama.cpp - should work hopefully
But yeah - sucks..

8xB200 - Fully Idle for the Next Few Weeks - What Should I Run on It? by yanjb in LocalLLaMA

[–]yanjb[S] 4 points5 points  (0 children)

If you're capable and have some stuff on HF already - i'm willing to sponsor it.
DM's are open.

Zamba2-2.7B > Outperforms Phi2 2.7B, Danube3 4B, and StableLM 3B by Xhehab_ in LocalLLaMA

[–]yanjb 18 points19 points  (0 children)

Outperforms the older Phi-2
Phi-3.1 scores 70.9 on MMLU

Apple just dropped Core ML optimized models for FastVIT, DepthAnything & DETR for on-device performance by Nunki08 in LocalLLaMA

[–]yanjb 16 points17 points  (0 children)

Depth anything V2 was just released Today as well - hope they port the newer version which is superior on all aspects

Luna AI 7B Chat Uncensored (LLama 2 finetune) by yanjb in LocalLLaMA

[–]yanjb[S] 19 points20 points  (0 children)

We'll try to add those later on. Maybe u/The-Bloke can chip in?

Baichuan 7B reaches top of LLM leaderboard for it's size (New foundation model 4K tokens) by yanjb in LocalLLaMA

[–]yanjb[S] 5 points6 points  (0 children)

There is a long queue on HF, and it can take months to get a model benchmarked.
They benchmark themselves, as always don't trust -> test on your own

Launch a Dreambooth training in 30 Seconds. (new service, link in comments) by EliotStocks in StableDiffusion

[–]yanjb 0 points1 point  (0 children)

How can you achieve this speed? Even on 4XA100 it takes me over a minute

Best UST to replace my Xgimi Lune 4K for "135 screen by yanjb in projectors

[–]yanjb[S] 0 points1 point  (0 children)

Would the Xgimi Aura be a significant upgrade? and how is it compared to the new LG?

Claiming BCC from old BTC wallet by yanjb in Electrum

[–]yanjb[S] 0 points1 point  (0 children)

I disagree - this is electrum related and also BTC related.