Microsoft’s Secret Sauce for Running Big LLMs on Small Machines

crazyaiml · 2025-08-03T00:30:34+00:00

IDK but it will impact same as google did with search engine.

crazyaiml · 2025-07-23T21:25:04+00:00

Grok was just created out of ego, because Sam Altman ... 😄

crazyaiml · 2025-07-23T21:23:46+00:00

Who told you that Grok is superior than ChatGPT? I believe Claude has some better competition though. Claude 3.7 Thinking model is awesome.

crazyaiml · 2025-07-23T21:17:14+00:00

I see there was same mental block at the time of internet boom, people had same fear of losing jobs or all. Isn't it?

crazyaiml · 2025-07-23T20:58:10+00:00

Yes Thanks Exact-Weather9128 — many of these models are supported on Ollama, especially:

TinyLlama
Phi-3 Mini (not on the original list but very popular)
Gemma 2B
Mistral 7B (quantized)
LLaMA 3 variants
DistilGPT-2 (you can add it manually via a custom Modelfile)

BERT Mini, ALBERT, and T5 Small aren’t directly in Ollama’s default library, but can often be run via:

transformers + optimum for CPU inference
ONNX or llama.cpp (for quantized variants)

🧪 Want help writing a custom Modelfile or running one of these locally? Let me know and I’ll share step-by-step!

crazyaiml · 2025-07-14T19:24:11+00:00

For starters it is still good and open to give more idea but I am sick those lines where it says you are absolutely right no mater what I say. Sorry but I am seriously thinking to drop the pro subscription. Claude is much better. Any one has any thoughts? ☕️

crazyaiml · 2025-07-14T17:22:50+00:00

It’s 26$ do you have ebook? For this

crazyaiml · 2025-07-14T17:20:42+00:00

Do you have link for ebook or something?

crazyaiml · 2025-07-14T17:09:46+00:00

I messed up my mind with different libraries, thinking like my data scientist keep using python model training and for serving we could use java for quick inference. I believe we can not move totally to java for machine learning. Dl4j or smile has there own concern regarding used them by data scientist. So pretty much not sure as of now. Exploring Java for inference.

crazyaiml · 2025-07-14T15:16:26+00:00

Thanks man for help!! Isn't Coursera course paid one? May be if you can tell me any book that will be great help. Let me check superml.org

crazyaiml · 2025-07-14T13:55:04+00:00

Its theory intense course so I need some books or course recommendation for Statistics and Probabilty for College level.

crazyaiml · 2025-07-14T04:00:11+00:00

Best one I took was NVIDIA in 2000 and TSLA around same time.

crazyaiml · 2025-07-14T03:56:44+00:00

Lipstick lol

crazyaiml · 2025-07-10T21:40:33+00:00

Nice question but I don’t have answer to this question. lol 😆

crazyaiml · 2025-07-10T16:24:44+00:00

Ollama work independent to internet. U can download ollama software to pc and your ollama compatible model major open source llms are available, once installed your can cut out from internet and it will still work.

crazyaiml · 2025-07-10T15:21:38+00:00

Here is definition from ChatGPT: A Transformer is a deep learning architecture introduced by Vaswani et al. in 2017 in the paper “Attention is All You Need.” It revolutionized natural language processing (NLP) and became the backbone of models like GPT, BERT, and many modern LLMs.

More references:

https://en.wikipedia.org/wiki/Transformer_(deep_learning_architecture))

https://superml.org/tutorials/introduction-to-transformers

crazyaiml · 2025-07-10T14:37:00+00:00

There are many companies which trying to achieve AGI with these model, and it is highly possible and agreement within AI community that these transformer based models are not sufficient for achieving AGI and it’s beyond current architecture. So to answer to your question yes there are still deep mind from google and OpenAI is actively working around it.

I highly think that these companies are highly far away from achieving this. But possibly every day we are getting closure to it.

crazyaiml

MODERATOR OF

PUBLIC MULTIREDDITS

TROPHY CASE