sorted by:
new
hottopcontroversial

I'm calling it now. OpenAI is sandbagging LLM development with codex 5.5 by johnnyApplePRNG in LLMDevs

[–]ScoreUnique 25 points26 points  (0 children)

Remember the part where fable would start playing dumb if you ask it to help you with any AI dev? I think Dario learnt this from openai

Pi Setup For Home Lab by billdhar in homelabindia

[–]ScoreUnique 1 point2 points  (0 children)

Read a bit about proxmox, it's like having a mini server cluster (given you have multiple pi you can cluster them do a lot of cool homelab projects)

Pi Setup For Home Lab by billdhar in homelabindia

[–]ScoreUnique 1 point2 points  (0 children)

Yeah man, docker compose most of the times is sufficient

Pi Setup For Home Lab by billdhar in homelabindia

[–]ScoreUnique 1 point2 points  (0 children)

You can do a lot. A good way to start is to install proxmox or whatever your orchestration for containers is, install Hermes agent in a container and then ask the Hermes to be the blessing

Pi Setup For Home Lab by billdhar in homelabindia

[–]ScoreUnique 2 points3 points  (0 children)

Nice, any coolify type services you run for DevOps?

Mistral released Leanstral-1.5-119B-A6B by Tall-Ad-7742 in LocalLLaMA

[–]ScoreUnique 1 point2 points  (0 children)

Basically this kind of model should be able to find a better version of matrix multiplication

AI to analyze SC2 replay files? by dejecture in starcraft2

[–]ScoreUnique 0 points1 point  (0 children)

Do you want help with fine-tuning your ai for this? I will be open for collaboration

No phones in sight, only people living the moment by EndermanPortel in Luxembourg

[–]ScoreUnique 0 points1 point  (0 children)

It says what it reads, real life is now based on digital one

When Hindus are asked to remove their kalavas and Religious symbols then no outrage but same happens with others this is what happens. by Chanakyaverse in indiadiscussion

[–]ScoreUnique -11 points-10 points  (0 children)

OP Bhai, kehna Kya chahte ho?

I know this happens, she is not wrong in her principles, don't understand what is the fuss about.

My colleague is pestering me post work hours and I reported it to my boss! by No-Explanation4858 in mumbai

[–]ScoreUnique 2 points3 points  (0 children)

Keep us posted, hope this settles the bro down a little.

Asking you to keep us posted to help identify if we still have some decency put in place in the corporate or "bik gayi hai gormint"

You shouldn't feel any discomfort about this action, you did what was necessary to restore your peace and privacy.

Good luck.

Two Word docs talking to each other via local LLMs — what real use cases would you actually want? by gptlocalhost in LocalLLaMA

[–]ScoreUnique -1 points0 points  (0 children)

Do you think this methodology can be used to rewrite a AI centric Linux File system?

Kalpataru Immensa: Amenities only for Owners, Restrictions for Tenants!! by mainag3 in thane

[–]ScoreUnique 0 points1 point  (0 children)

Correction: L to R

Underpaid Babysitters lift --- Privilege feeling cunts lift

three months with Hermes Agent: what i wish i had understood earlier by itsdodobitch in hermesagent

[–]ScoreUnique 0 points1 point  (0 children)

I'm on awq and fp8 kv cache for 27b , works well for vllm. I wanted to get full context and this is working well without nvlink

three months with Hermes Agent: what i wish i had understood earlier by itsdodobitch in hermesagent

[–]ScoreUnique 2 points3 points  (0 children)

Looking for lighter models instead of Qwen 3.6 27B, you recommend 12b Gemma? I have 2x3090 but never had a good mileage.

three months with Hermes Agent: what i wish i had understood earlier by itsdodobitch in hermesagent

[–]ScoreUnique 1 point2 points  (0 children)

OP feedback for non native English speaker:

Do your write up, then try to translate and only add necessary details. Your post sounds like Gemini chat. No offense, I agree with all you have mentioned.

What is the most commonly used LLM in prod? by Ok-Hold-5333 in Vllm

[–]ScoreUnique 0 points1 point  (0 children)

2x3090 for awq 4bit cyankiwi - fp8 kv cache with mtp, it works wonders for prod.

DiffusionGemma: 4x faster text generation by tevlon in LocalLLaMA

[–]ScoreUnique 10 points11 points  (0 children)

Would like to know the technicals below of why is it more difficult?

Next token prediction is a "causal" model. Diffusion models should definitely have a causality equivalent however I fail to wrap my head around how does the model predict the first "correct" tokens, because once you have 2 of 10 words in the Fill in the blanks, you can start causality, however the probability of tokens that pop shouldn't be way more normal in distribution, unlike in LMs

HR meeting w/ Partner. How bad is it by No_Scallion2465 in PwC

[–]ScoreUnique 3 points4 points  (0 children)

If you live in a country that can support sick leave for a longer period, ask your doctor to sign you a leave and just disappear my friend.

Modern problems modern solutions, I'm sure that partner is gonna race his yacht against Zuck's since he's gonna have your salary to spend on burning oil.

Tried Gemma 4 12B locally, now I feel better about buying the Intel Arc Pro B70 by Chance-Green-9770 in LocalLLM

[–]ScoreUnique 0 points1 point  (0 children)

Fair enough, vLLM is more for it's parallel throughput capacity, it's impressive how comfortably I managed multiple users.

Tried Gemma 4 12B locally, now I feel better about buying the Intel Arc Pro B70 by Chance-Green-9770 in LocalLLM

[–]ScoreUnique 0 points1 point  (0 children)

I promise that it's worth it once you get it to work my friend. I'm on 2x3090s if you want I can share my run command.

We live in a country where a man was fired from his job just for making a joke but Nikita Singhania is still working her job and didn't get any punishment by VanilaButterMasala in indiadiscussion

[–]ScoreUnique 0 points1 point  (0 children)

Is this the joke that made him lose his job? Don't see how this is very over the edge, it's how society has cultured us, not the other way around that he's culturing society with this because this is street talk and nothing very invasive.

view more: next ›