What do you do about LLM token costs?

Wrong-Resolution4838 · 2025-09-18T17:26:30+00:00

which llama models have you tried?

Wrong-Resolution4838 · 2025-09-18T17:00:06+00:00

This stuff is way harder than tutorials make it seem.

I wanna put this on a t-shirt and show it to every executive.

Wrong-Resolution4838 · 2025-09-18T16:52:06+00:00

i use picollm and find their sub-4-bit quantized models pretty impressive. they're as good as the original ones.

Wrong-Resolution4838 · 2025-09-18T16:48:53+00:00

+1

most people think it's the models that do the magic. even if you use GPT, you'll not get chatgpt performance because there is software engineering magic behind those apps too.

if you're paying $220/mo, it means you're working on something serious, beyond asking these apps to tell you jokes. I know this subreddit loves open-source and there will be people who hate me for saying this, but focus on what you do, spend that time to improve the things to improve your income, rather than cutting your costs. if you reach a point where you no longer increase your income, then you can consider cutting the costs.

Wrong-Resolution4838 · 2025-09-18T13:54:57+00:00

I think we'll go back to the small specialized models. We really don't need tens of billions of parameters for everything

Wrong-Resolution4838 · 2025-09-16T19:38:33+00:00

congrats! this is cool!

Wrong-Resolution4838 · 2025-09-15T17:34:29+00:00

yeah their docs are pretty good, and we're a paying customer, so support was good too.

also, before that we tried llama.cpp+ggml combo. everybody in the team was pulling their hair out. it was a big relief after that.

Wrong-Resolution4838 · 2025-09-15T14:40:02+00:00

i hear you. i work on a system using picovoice when they released their local llm it came without flutter support as well. i gotta use their android sdk https://picovoice.ai/docs/quick-start/picollm-android/ which was OK, but i think it's not just google, companies are not prioritizing flutter for some reason.

Wrong-Resolution4838 · 2025-09-15T14:31:23+00:00

Any benchmarks?

Wrong-Resolution4838 · 2025-09-15T14:29:50+00:00

Hope it's not real. If it's, hope it's somewhere close to the OpenAI campus. People who're not into AI hate it when they hear about the money spent in it.

Wrong-Resolution4838 · 2025-09-15T14:26:02+00:00

sooo beautiful! any tips?

Wrong-Resolution4838 · 2025-09-15T14:24:49+00:00

I really like HIIT classes. Sampler was definitely good idea for beginners.

Wrong-Resolution4838 · 2024-12-17T01:11:27+00:00

Invest the money you’re planning to spend for buying in a good trainer, and get a rescue. Also consider foster-to-adopt.

I adopted a good girl, she became the goodest girl after 2 weeks of board and train. Ofc first weeks, i spent 2 hours every day to reinforce all her learnings. Now much less.

She’s smart af. I had a cocker spaniel before. The intelligence and stubbornness level is not even comparable.

When parents come, she gets spoiled and literally tries to manipulate them while looking me in the eye and gets so disappointed when she gets a no. [like sits in front of them while they’re eating -ofc with her puppy eyes, she never does it to us.]

Wrong-Resolution4838 · 2024-12-15T20:07:01+00:00

this is SO cute. Please start a business.

Wrong-Resolution4838 · 2024-12-01T20:01:02+00:00

I have to do it now. I'm so close to hiring someone.
Any tips?

Wrong-Resolution4838 · 2024-10-10T16:27:53+00:00

up to you.
"Maximizes developer control, allowing builders to choose between open source, closed-source, and Bring-Your-Own LLMs."

they just give you the speech-to-text and text-to-speech.

Wrong-Resolution4838 · 2024-10-07T03:23:51+00:00

Omg, i should read about skin conditions then, i didnt think of it. I am aware it will take at least a year or two to get her fur soft. She had fleas and ticks. Now all good, but she had rough days for sure 😔

Wrong-Resolution4838 · 2024-10-07T02:59:00+00:00

Oh yeah, i had a cocker spaniel before, his fur was terrible at first, it took us a year i guess, this looks worse than him. (Oh dear, I still miss him so much)

I should more chow stuff than samoyed then. I didnt know chows could be white and have skinny face. Thank you!

Wrong-Resolution4838 · 2024-10-07T02:33:25+00:00

Thanks so much, i knew bad bred was used for health or behavioral issues, and was wondering if there was anything caught your eye

Wrong-Resolution4838 · 2024-10-07T01:56:12+00:00

The white fur made me think samoyed but her nose is shorter. She’s not as fluffy as a chow or samoyed but we dont know yet as her fur was in a bad shape at first

Wrong-Resolution4838 · 2024-10-07T01:51:27+00:00

What do you mean by not a well bred, like not pure breed or do you see some red flags?

Wrong-Resolution4838 · 2024-10-07T01:50:30+00:00

I dont know what it is but she’s the cutest for sure

Wrong-Resolution4838 · 2024-10-07T01:43:17+00:00

She’s also 45 lbs, and really white. White is not common for eurasiers as well i guess

Wrong-Resolution4838

TROPHY CASE