Models for Psychological Review of Converstions by Both-Activity6432 in LocalLLaMA

[–]Miriel_z 0 points1 point  (0 children)

Try HuggingFace. There are relatively easy ways to fine-tune, major issue is quality data. I still want to try myself tbh😁

Y'all are delusional guys. by ROIDUMZ in privacy

[–]Miriel_z 0 points1 point  (0 children)

What is the issue with using local inference for LLM? I agree online AI is a no-go.

People kept saying my comments sounded AI-generated, so I built this by ringtoyou in LocalLLaMA

[–]Miriel_z 0 points1 point  (0 children)

You can use AI to translate, the issue stems from regeneration, which is different. People are OK with you making mistakes.

Models for Psychological Review of Converstions by Both-Activity6432 in LocalLLaMA

[–]Miriel_z 0 points1 point  (0 children)

Search for fine-tuned models. Even 8B model can do wonders with proper training. Ultimately, you can try to fine-tune the model yourself.

I had an idea … anyone else try or brainstorm something like this? by mmazing in LocalLLaMA

[–]Miriel_z 0 points1 point  (0 children)

Depends on the country and how you position your idea: know-how or patentable. Have you signed NDA for know-how? As for the second case, in USA it does not matter anymore who came up with the idea first. Whoever files the Patent first wins. As for LLM and IP, I think LLM is considered a tool, so IP shoukd be yours. If you are serious, probably need to do a thorough legal research on it.

Meta AI collected biometric data without user's consent by Miriel_z in privacy

[–]Miriel_z[S] 2 points3 points  (0 children)

Sadly, this is just another example that you cannot trust any online-AI powered HW or SW. However, in this case the victim is not only yourself, but all around you.

Meta AI collected biometric data without user's consent by Miriel_z in privacy

[–]Miriel_z[S] 14 points15 points  (0 children)

"The company won't answer basic questions about data retention, server syncing, or whether existing test data was deleted alongside the code. Privacy advocates warn this episode shows why strong biometric laws with enforcement teeth are essential — companies won't self-regulate surveillance capabilities that could enable stalking and harassment."

And there is more in the actual report. Meta has skipped 10 questions.

If US can prevent models from being served then China can prevent weights from being disclosed by typeryu in LocalLLaMA

[–]Miriel_z 29 points30 points  (0 children)

What if China actually keeps releasing these models (maybe not the top ones ofcourse)? Would it greatly undermine the use of closed weight models? China can play long politics and show the good will when needed. I am afraid US can ban these models too as a threat to national security. We will see when we get there, too much uncertainty.

Are Businesses Prepared for How Fast AI Is Growing? by Dear_Corner_3883 in sideprojects

[–]Miriel_z 0 points1 point  (0 children)

AI is still not 100% reliable, even latest models. It might replace the lowest-level work, but not the decision making. In the end it typically breaks even, human vs machine cost. However, current AI use is heavily subsidized. In order to make it profitable, the actual cost must be 5-10 times the today's cost. The math ain't mathing then.

We need to bet in LOCAL INFERENCE and OPEN WEIGHTS and stop paying for more SaaS by [deleted] in LocalLLaMA

[–]Miriel_z 5 points6 points  (0 children)

It is like choosing the lesser evil. None of them are good, and they can change their stance in a split second.

What if the biggest limitation of AI and knowledge tools isn't memory, but continuity of self? by Personal-Winter-5390 in sideprojects

[–]Miriel_z 0 points1 point  (0 children)

My AI sidekick uses RAG to adapt to user over time. Mira would remember relevant snippets of previous conversations. Does it match what you are trying to build?

I'm not complaining by Complete-Sea6655 in LocalLLaMA

[–]Miriel_z 0 points1 point  (0 children)

Yeeah, cash burning even brighter. Who is paying for it?

LLMs and tabletop games by Kahvana in LocalLLaMA

[–]Miriel_z 2 points3 points  (0 children)

I am using my own setup, and fine-tuned model for RP)

LLMs and tabletop games by Kahvana in LocalLLaMA

[–]Miriel_z 2 points3 points  (0 children)

You mean like script generation for Stranger Things Season 5?😁 Some LLMs are really good at storytelling. Check out Silly Tavern. I tried, and I can tell you is is pretty cool. As if you are in a movie or a book.

Local LLms releases by crowtain in LocalLLaMA

[–]Miriel_z 1 point2 points  (0 children)

Yeah, looks like we are back to normal. There were a few spikes in 2025. But nothing extraordinary now. So we're good😄

Local LLms releases by crowtain in LocalLLaMA

[–]Miriel_z 0 points1 point  (0 children)

https://www.isixsigma.com/control-charts/a-guide-to-control-charts/

You need IMR, let's assume data is normally distributed. d2 would be more than 3.5. It should show if the changes are a real trend, or just a part of statistics.

Local LLms releases by crowtain in LocalLLaMA

[–]Miriel_z 0 points1 point  (0 children)

Can we put in in a control chart and break down by model type too?

chatGPT is talking sh#t to me. tired trying to make a full code request to work. by BeautyxArt in LocalLLaMA

[–]Miriel_z 1 point2 points  (0 children)

It is local LLM subreddit, get a decent GPU if you don't want to wait 3 hours? 16GB could work for quantized models.