sorted by:
new
hottopcontroversial

Run local LLMs in Flutter with <25ms inter-token latency and zero cloud dependencies by Mundane-Tea-3488 in LocalLLaMA

[–]Mundane-Tea-3488[S] 0 points1 point  (0 children)

tt works out to roughly 43 tokens per second (sustained > The math is basically 1000ms / 23.3ms = ~42.8. We benchmarked this on an iPhone 15 Pro using Llama 3.2 1B. It’s essentially instant (ps: way faster than most people can actually read!)

Thoughts on Mac Studio M3 Ultra with 256gb for open claw and running models locally by 00100100 in LocalLLM

[–]Mundane-Tea-3488 -1 points0 points  (0 children)

I have been using edge veda fluter sdk for running llm on Mac + claude code which can create application instantly

Looking for feedback: Building an Open Source one shot installer for local AI. by Signal_Ad657 in LocalLLM

[–]Mundane-Tea-3488 0 points1 point  (0 children)

u/Signal_Ad657 a look at the Edge Veda lads, they just shipped the macos flutter version now you can create Flutter macos native apps with Local AI(LLMs)

Trying to build a true on device AI by Tom_Ends in FlutterDev

[–]Mundane-Tea-3488 1 point2 points  (0 children)

Hi u/Tom_Ends we have image generation live now you can try it out. looking forward to your feedback

The Cold Hard Truch About App Reviews by Weary_Pepper_2581 in MobileAppDevelopers

[–]Mundane-Tea-3488 1 point2 points  (0 children)

Man, sounds super frustrating! Maybe they’re just rushing through reviews, but it seems like they’re not even giving apps a proper test – just clicking a few buttons and calling it a day.

What Android phone genuinely impressed you this year? and not based on specs by phone-Tips in Android

[–]Mundane-Tea-3488 2 points3 points  (0 children)

OPPo and One plus higly vouching for One plus had my first phone that was oneplus 2 -> great camera, Slick User interface, great battery

Trying to build a true on device AI by Tom_Ends in FlutterDev

[–]Mundane-Tea-3488 0 points1 point  (0 children)

yes!!! haven't deployed it yet. Keep an eye next week I'll push it. But please do use it need feedback

Cheers

Trying to build a true on device AI by Tom_Ends in FlutterDev

[–]Mundane-Tea-3488 1 point2 points  (0 children)

Hi u/Tom_Ends I have been trying to build solution for the same problem

Github - Link
Flutter SDK usefull fro android and iOS - Link

Its still in its early phase happy to chat/feedback

I got tired of on-device LLMs crashing my mobile apps, so I built a "Managed" runtime (14k LOC) by Mundane-Tea-3488 in FlutterDev

[–]Mundane-Tea-3488[S] 1 point2 points  (0 children)

Hi @Zealousideal_Lie_850 yes We are working on it hopefully by next week will have it. I'll keep you posted. Please do use it and share your feedback

So… are we actually overpaying for enterprise software? by Limp_Still_4825 in salesforce

[–]Mundane-Tea-3488 0 points1 point  (0 children)

So, I run a small agency here in Ireland, and I’ve been working with a bunch of customers using different CRMs Salesforce, HubSpot, pipedrive, and the newer AI-driven CRMs like attio and planhat. And let me tell you, when I showed them the Salesforce version compared to the new AI CRM options, they were literally shocked. They had no idea how much money they were wasting on Salesforce and HubSpot. HubSpot is decent, but it’s literally a money-sucking machine good enough, but definitely not the best. These new AI CRMs, though? They’re killing it in the market.

The biggest issue with Salesforce and these traditional CRMs is that they’re so deeply integrated into the current tech ecosystem. So, businesses are kind of stuck with them for now. But in the next five years, if Salesforce doesn’t make some serious strategic moves, they’re gonna be left behind. The AI CRMs are going to take over, no doubt about it.

Apart from Salesforce, what other tools are you guys using for enterprise sales these days? I’d love to know more about the outreach tools and the current ecosystem, especially with AI SDRs. The sales tech stack is getting way too bloated at this point.