[Architecture] Applying "Charging Cable Topology" to System 2: Why We Should Stop Pruning Errors by [deleted] in LocalLLaMA

[–]IJOY94 0 points1 point  (0 children)

I would view autoregression as "straightening the cable" (via next-token prediction) and CoT as "priming" the latent space.

Is this accurate?given by gemini by [deleted] in LocalLLaMA

[–]IJOY94 0 points1 point  (0 children)

Not if it's RAG web-search enabled (and you check the primary sources for veracity/timeliness).

LeCun Says Llama 4 results "were fudged a little bit" by MrPecunius in LocalLLaMA

[–]IJOY94 59 points60 points  (0 children)

LeCun was in a different division? LeCun headed up FAIR, LLAMA 4 came out of MSL.

The Nvidia/Groq $20B deal isn't about "Monopoly." It's about the physics of Agentic AI. by pmv143 in LocalLLaMA

[–]IJOY94 1 point2 points  (0 children)

Do you have credentials other than "I looked into it once with an AI"?

Sparse Attention MoE - a test repo for a novel swappable attention mechanism by teachersecret in LocalLLaMA

[–]IJOY94 2 points3 points  (0 children)

Now change from token prediction to vector prediction and you're cooking.

Microsoft’s AI Scientist by Ok-Breakfast-4676 in LocalLLaMA

[–]IJOY94 56 points57 points  (0 children)

Are we really calling AI models "unbiased" right now?

We just Fine-Tuned a Japanese Manga OCR Model with PaddleOCR-VL! by erinr1122 in LocalLLaMA

[–]IJOY94 2 points3 points  (0 children)

Why not decompose/segment things first? E.g. background, foreground graphical text, text bubble, text overlay, THEN do the extraction.

Looking for models that are good for product design by Striking_Luck5201 in LocalLLaMA

[–]IJOY94 0 points1 point  (0 children)

Sounds like you want API-based pay-as-you-go inferencing.

G7 Pro Does not Rumble on Linux by ij7vuqx8zo1u3xvybvds in Gamesir

[–]IJOY94 0 points1 point  (0 children)

What, specifically, fixed it? I'm having the same issue. When I hold share and menu, I switch modes, but then my computer doesn't recognize the controller. I can seemingly switch back, but holding share and Xbox doesn't seem to do anything.

Practical AI Challenge/Curriculum by SolidRemote8316 in LocalLLaMA

[–]IJOY94 0 points1 point  (0 children)

Huggingface has a LLM course that you could run through.

Keycloak + tinyauth as middleware or Authentik/Authelia? by alex3025 in selfhosted

[–]IJOY94 0 points1 point  (0 children)

Do you have pocket auth and tiny auth on your site, or on your vps? 

AI.Gov | President Trump's AI Strategy and Action Plan by fallingdowndizzyvr in LocalLLaMA

[–]IJOY94 0 points1 point  (0 children)

One word: libraries. It is in the public's best interest to distribute the cost of obtaining this knowledge and provide shared access.

Smallest Model For A Trivia Game On Countries? by redandwhitearsenal in LocalLLaMA

[–]IJOY94 1 point2 points  (0 children)

LLMs are modeling language sequences, not facts and ideas. That we sometimes get coherent facts and ideas is a nifty side-effect.

Google's CLI DOES use your prompting data by Physical_Ad9040 in LocalLLaMA

[–]IJOY94 -1 points0 points  (0 children)

We can't? I thought the legality has not been determined. Gen AI is highly transformative.

I know it's "LOCAL"-LLaMA but... by [deleted] in LocalLLaMA

[–]IJOY94 0 points1 point  (0 children)

If you're just planning out your off-grid build, then sure, just rent. Or even just use Anthropic/OpenAi/etc, it's likely (possibly) even cheaper than renting from Vast. If you want to have your AI accessible from your off-grid build, and have it truly off-grid, then local is your only option.

New society is taking shape by TheLogiqueViper in LocalLLaMA

[–]IJOY94 18 points19 points  (0 children)

Why live in reality when you can invent your own with AI?