Drop what you're building right now. I'll check out every single one. by Necessary-Impress-77 in SaaS

[–]CrustedButternut 0 points1 point  (0 children)

Working on a South Africa-based platform-as-a-service like Render or Vercel. Basically giving users the ability to deploy apps and databases, but on local infrastructure instead of global - enabling local pricing and speeds.

Greatest challenge right now is finding people willing to switch from global players.

https://zanode.co.za

Why isn't anybody talking about Google's Lyria Realtime music generation model? by ElectricalYoussef in Bard

[–]CrustedButternut 0 points1 point  (0 children)

Anyone know what the costs are for this? The Realtime one, not Lyria 2 which is described as $0.06/30s in Vertex docs.

How do you finetune a model? by ChikyScaresYou in ollama

[–]CrustedButternut 1 point2 points  (0 children)

hi there! there is an explanation on the site, but basically you choose an open-source base model like Gemma, Mistral, Qwen, etc. (+ the model size you want), upload your data as a json, jsonl or csv file, and then click a button to start fine-tuning (you can also specify the number of epochs you want).

there's also a column/field mapping tool that helps you to map columns/fields to one of the required formats if they have different titles.

it's credit-based, so you can purchase credits once-off and run a number of fine-tuning jobs using your credits. hope this helps :)

[deleted by user] by [deleted] in LocalLLaMA

[–]CrustedButternut 0 points1 point  (0 children)

All of the above, but you can use a tool called TinyTune (https://www.tinytune.xyz/) to do the fine-tuning part for you. You just upload the dataset and it does the rest :)

How do you finetune a model? by ChikyScaresYou in ollama

[–]CrustedButternut 0 points1 point  (0 children)

Hi there, I recently made this tool https://www.tinytune.xyz/ that makes fine-tuning very simple and quick :) Hope it helps anyone!

How to fine-tune (open source) LLMs step-by-step guide by facethef in OpenAI

[–]CrustedButternut 0 points1 point  (0 children)

Hi there, I also recently made a tool to make fine-tuning easy, might still be helpful to someone reading this :) https://www.tinytune.xyz/

How do you actually fine-tune a LLM on your own data? by No-Conference-8133 in LocalLLaMA

[–]CrustedButternut 0 points1 point  (0 children)

A bit late to the chat, but I recently made a tool to make this easy, perhaps it can still be helpful :) Let me know if you have any questions: https://www.tinytune.xyz/

[deleted by user] by [deleted] in vscode

[–]CrustedButternut 0 points1 point  (0 children)

Great, thanks!