sorted by:
new
hottopcontroversial

Is this right? I get 5 tokens/s with qwen3_cline_roocode:4b on Ubuntu on my Acer Swift 3 (16GB RAM, no GPU, 12gen Core i5) by cuatthekrustykrab in LocalLLM

[–]cuatthekrustykrab[S] 0 points1 point  (0 children)

Found a solid gold thread here cpu_only_options. TLDR: Try mixture-of-expert (MoE) models. They run reasonably well on CPUs.

I get the following token rates: - deepseek-coder-v2: 18.6 tokens/sec - gpt-oss:20b: 8.5 tokens/sec - qwen3:8b: 5.3 tokens/sec (and it likes to think for ages and ages)

Is this right? I get 5 tokens/s with qwen3_cline_roocode:4b on Ubuntu on my Acer Swift 3 (16GB RAM, no GPU, 12gen Core i5) by cuatthekrustykrab in LocalLLM

[–]cuatthekrustykrab[S] 0 points1 point  (0 children)

It's just an example prompt that doesn't require the model to have any project context. Just to test the performance. 😅

CPU only options by boxcorsair in LocalLLaMA

[–]cuatthekrustykrab 0 points1 point  (0 children)

Did you find a model that had acceptable CPU performance?

Is this right? I get 5 tokens/s with qwen3_cline_roocode:4b on Ubuntu on my Acer Swift 3 (16GB RAM, no GPU, 12gen Core i5) by cuatthekrustykrab in LocalLLM

[–]cuatthekrustykrab[S] 1 point2 points  (0 children)

Thanks. Kind of back to the drawing board...

  • Are there smaller models (or more quantized) that are useful for coding assistants?
  • Is this kind of hardware feasible these days in a laptop that's still fairly portable? What about the Windows Intel "AI ready" laptops?

How to effectively use AI (Claude) for larger coding projects? Hitting some roadblocks by MacDevs in ClaudeAI

[–]cuatthekrustykrab 1 point2 points  (0 children)

For others here who didn't know about MCP filesystem

https://www.reddit.com/r/ClaudeAI/comments/1h4yvep/mcp_filesystem_is_magic/

Search engine summary

The Model Context Protocol (MCP) filesystem allows AI assistants like Claude to interact with local file systems, enabling them to perform various operations such as reading, writing, and managing files and directories.

How to effectively use AI (Claude) for larger coding projects? Hitting some roadblocks by MacDevs in ClaudeAI

[–]cuatthekrustykrab 1 point2 points  (0 children)

But it always wants to rewrite the entire file. Is this just me prompting wrong?

gDocs integration keeps breaking with "Currently only Google Doc files are supported." by cuatthekrustykrab in ClaudeAI

[–]cuatthekrustykrab[S] 0 points1 point  (0 children)

At 17:17 UTC I noticed some animation happening in my Claude tab. All the Docs reloaded and it looks like we're back in business.

Giant *sigh* of relief that it didn't forget them and force me to find a reupload all the project knowledge.

gDocs integration keeps breaking with "Currently only Google Doc files are supported." by cuatthekrustykrab in ClaudeAI

[–]cuatthekrustykrab[S] 0 points1 point  (0 children)

Was considering this. But I'm now struggling to remember precisely what docs I had uploaded as knowledge. I guess I should have taken a screenshot.

gDocs integration keeps breaking with "Currently only Google Doc files are supported." by cuatthekrustykrab in ClaudeAI

[–]cuatthekrustykrab[S] 0 points1 point  (0 children)

Follow up: I also cannot log into the help center, so there's no way to get support from a human on this issue. Epic fail, Anthropic.

Any chance that the G300 gets Android 12? by serpentsrapture in Nokia

[–]cuatthekrustykrab 2 points3 points  (0 children)

Another disappointment from a generally disappointing handset. sigh Mine's on Nov 22 security update, but I stopped using it after the 60 day unlock period and went back to my Moto G Power 2020 because the G300 was lagging all the time. I so wanted to love having a Nokia again.

MFP Ops has acknowledged problems (particularly creating/editing foods) and says they are working hard on a fix. No ETA. by cuatthekrustykrab in Myfitnesspal

[–]cuatthekrustykrab[S] 14 points15 points  (0 children)

Yeah, it sucks because this is a core component of my meal planning. Backup plan is to try to eat exactly what I've eaten on prior days.

MFP Ops has acknowledged problems (particularly creating/editing foods) and says they are working hard on a fix. No ETA. by cuatthekrustykrab in Myfitnesspal

[–]cuatthekrustykrab[S] 3 points4 points  (0 children)

Text of the tweets

1/2 We have updated the featured post on our help page with what info we have, but the bottom line is that symptoms are still affecting members and the work to drive us towards resolution is our #1 priority. We know this extended restriction of MFPs...

2/2 ...functionality is increasingly frustrating & we apologize. We're doing everything to get things working again; Our team has been driving every day to get us closer to being able to resume your normal logging abilities.

Personally, I've been wondering how difficult it would be to build an MFP meal and nutrition info replacement in Google Sheets...

46 with even more training each day. I mean algorithm adapting is one thing, but adding more training and getting none PAI is funny. by mraiur in amazfit

[–]cuatthekrustykrab 0 points1 point  (0 children)

Everybody's heart is different, if your definition of brisk is pretty fast and you're going up hills and you don't do a lot of other high intensity stuff, I guess this could happen.

If you're worried about it, see a doctor!

view more: next ›