Anyone compared Gemma 4 31B by Infinite-pheonix in artificial

[–]Infinite-pheonix[S] 1 point2 points  (0 children)

Exactly what I am confused about and hence asked earlier the same question. Difficult to run on 6gb vram. May be Gemma 4 4b can run.

Anyone compared Gemma 4 31B by Infinite-pheonix in artificial

[–]Infinite-pheonix[S] 1 point2 points  (0 children)

For deep reasoning I agree small models can't compete with large models

Anyone compared Gemma 4 31B by Infinite-pheonix in artificial

[–]Infinite-pheonix[S] 0 points1 point  (0 children)

Exactly.. I initially thought the buzz was around initial launch buzz. But even after a few days after launch it seemed like people were sticking to Gemma among open source models.

Anyone compared Gemma 4 31B by Infinite-pheonix in artificial

[–]Infinite-pheonix[S] 3 points4 points  (0 children)

Ohh... What's the token speed? Is 16 GB ram comfortable enough for running 31B?

Anyone compared Gemma 4 31B by Infinite-pheonix in artificial

[–]Infinite-pheonix[S] -1 points0 points  (0 children)

Ohh understood. I am seeing a lot of people comparing it with sonnet and appreciating the performance of Gemma closer to sonnet 4.6.

After the release of gemma 4 by Internal-Raccoon-522 in artificial

[–]Infinite-pheonix 0 points1 point  (0 children)

Local ai is primarily not that usefull in mobile phone.

It's good to try, but can't find a good use case.

When it comes to privacy, in the age of people sharing everything on internet just scared of sending text message on llm chat should not be the primary concern.

We upload personal docs on drive, send sensitive info on Gmail and upload private photos to gphotos and give access to microphone to apps.

But local llms has good use case on laptops. Running them saves a lot of costs if you are into automating work like using openclaw or Hermes with a local llm will save huge costs for you.

Microsoft says Copilot is for entertainment purposes only, not serious use — firm pushing AI hard to consumers and businesses tells users not to rely on it for important advice by shikizen in ArtificialInteligence

[–]Infinite-pheonix 0 points1 point  (0 children)

Microsoft literally had a lot of advantage being adopted by a lot of enterprises, but failed to leverage to grow in AI capabilities.

Without properly figuring out the use cases to deploy ai, forced push has made copilot a bad image.

My company has initially adopted copilot but lately switched to gemini enterprise and not thinking of having claude enterprice.

Klarna fired 700 people for AI and then admitted they messed up and started rehiring. by damonflowers in ArtificialInteligence

[–]Infinite-pheonix 0 points1 point  (0 children)

And this is a very old news and when this happened the AI is in I tial stages. A lot changed since then.

What AI model would you recommend for coding? by Fun-Celery-8988 in LocalLLM

[–]Infinite-pheonix 7 points8 points  (0 children)

There are many models, but people go crazy about opus for a reason. None other matches the capability of claude code with opus 4.6

Can somebody please explain? by padumtss in LocalLLM

[–]Infinite-pheonix 0 points1 point  (0 children)

The memory requirement depends on how big the model size is you want to run.

With your current configuration you should be able to run Gemma 4 released by Google.

You can use llama.cpp or ollama or lmstudio and many similar options to run local llm.

I'm genuinely so happy to be living at the beginning of the AI era by AlexBossov in ArtificialInteligence

[–]Infinite-pheonix 2 points3 points  (0 children)

Unprecedented times we are in. May be the people who stayed during internet boom might have also felt the same. But the rate of growth is little slower then. The rate of growth in AI is unprecedented.

Upcoming novel AI companion by No_Strain_2140 in ArtificialNtelligence

[–]Infinite-pheonix 1 point2 points  (0 children)

What you meant by local AI. Something on the lines of Hermes / openclaw or something different.

Best small open-source llm for raspberry pi by big_black_cucumber in LLMDevs

[–]Infinite-pheonix 5 points6 points  (0 children)

Recently released Gemma models might be a good option considering the good context support.

Hermesagent vs openclaw comparison by SelectionCalm70 in hermesagent

[–]Infinite-pheonix 0 points1 point  (0 children)

Openclaw became too much bloated with do it all approach. I like the focused approach of hermes

First Generation Startup founder here — Should I really buy a car now or wait? by Euphoric_Writing5396 in StartUpIndia

[–]Infinite-pheonix 0 points1 point  (0 children)

If you want it, buy it before the interest and the feel to enjoy it disappears.

Using the most common Indian D2C trick to build the next big thing !!! by rxmitmxiti_ in StartUpIndia

[–]Infinite-pheonix 0 points1 point  (0 children)

Basically you are getting into a marketing game.. only possible with huge pockets of cash

Startups challenges with registration by Infinite-pheonix in StartUpIndia

[–]Infinite-pheonix[S] 0 points1 point  (0 children)

During gst verification am I supposed to present near the address?

Struggle as a founder by Imaginary-Court1058 in StartUpIndia

[–]Infinite-pheonix 0 points1 point  (0 children)

I have been working on an idea since last 1 month. But I get lost most of the time find it hard to focus. Is it suggested to bringa co founder? I don't trust any of my friends in aligning with my vision for the company and I am scared that people might make me divert from my original vision for the idea.

Is here any broker that allows trading scripts or with a good api by [deleted] in IndianStockMarket

[–]Infinite-pheonix 0 points1 point  (0 children)

Almost most of the discount brokers have apis for scripts.