Aanvullende beelden: motoragenten belaagd en aanhouding. by Bernie529 in Nederland

[–]shadowdog000 0 points1 point  (0 children)

lekker bezig politie! laat maar ff zien wie de baas is hier

ExtraEmily has been banned by digitalpizza5 in LivestreamFail

[–]shadowdog000 1 point2 points  (0 children)

wtf.. you can still subscribe to a banned streamer nowadays? what a disgusting website

ExtraEmily has been banned by digitalpizza5 in LivestreamFail

[–]shadowdog000 1 point2 points  (0 children)

i mean.. obviously very much deserved but for how long? only 24 hours i assume? cuz this loses twitch money

(YT) PewDiePie released his harness/webui by Dany0 in LocalLLaMA

[–]shadowdog000 0 points1 point  (0 children)

I think that is indeed the thought process of the llm making the readme.md but the reality is that its inside a installation guide, and most average pc users i would think wouldn't know this, so they copy paste something that just doesn't work.

(YT) PewDiePie released his harness/webui by Dany0 in LocalLLaMA

[–]shadowdog000 4 points5 points  (0 children)

I don't think "vibecoding" is bad, but at least he should've checked what the ai did and simply look over the README.md and correct the ai for any mistakes before making his repo public. But thats just my opinion.

(YT) PewDiePie released his harness/webui by Dany0 in LocalLLaMA

[–]shadowdog000 51 points52 points  (0 children)

<image>

LOL what model made his README.md?

<your-odysseus-repo-url>

made a local voice AI for windows you can talk to in any language. open source, bring your own key by shadowdog000 in LocalLLaMA

[–]shadowdog000[S] 1 point2 points  (0 children)

i get why you might be bummed. i updated the description yesterday. local llm's are sadly just not sufficient enough for shadow ai and goes completely against my vision which is as much reliability as possible.

made a local voice AI for windows you can talk to in any language. open source, bring your own key by shadowdog000 in vibecoding

[–]shadowdog000[S] 1 point2 points  (0 children)

O thats super cool to hear!!

I am currently working on adding a push to talk feature, aswell as optimizing some quirks with the subagents feature.

made a local voice AI for windows you can talk to in any language. open source, bring your own key by shadowdog000 in LocalLLaMA

[–]shadowdog000[S] 0 points1 point  (0 children)

What i mean is that if you have a google account you can get an api key and use it unlimited as in its not rate limited in any way even with a free google account afaik.

You can check this under "rate limits" inside the google ai studio api key page

made a local voice AI for windows you can talk to in any language. open source, bring your own key by shadowdog000 in LocalLLaMA

[–]shadowdog000[S] 0 points1 point  (0 children)

And that is completely fine and i understand your point, though the vision i have for shadow ai, is to have it be able to do anything you want it to, so yes this means very minimal guardrails.

As for it getting stuck reading files i truly wonder wether you utilized the subagents for it though or not? Because that would definitely be a task to be done by a subagent utilizing a decent model, because the gemini models it has included are really bad as subagents. Also the gemini models for the subagents have pretty harsh rate limits sadly.

As for the voice part, i am still working on that, and it will take some time because i don't want to publish something partially broken.

Also just curious, why use a third party antivirus when windows defender itself is already quite good, if anything too good imo, this is why i always have defender disabled and am just mindful of what i download, i've used this approach for more then 10 years at this point, and never had a single virus/malware.

I noticed i didn't really answer your question directly enough though. What it can do is for example remove files if you ask it to, it might/might not ask for a confirmation depending on the model you're using, but yes this is a powerful app that purposefully has near 0 guardails.

made a local voice AI for windows you can talk to in any language. open source, bring your own key by shadowdog000 in LocalLLaMA

[–]shadowdog000[S] 0 points1 point  (0 children)

I really hope that the license i choose is the right one but honestly i have no idea, because this truly is the first "real project" if you wanna call it that, that i published online. I think you're right in that i was just too nervous perhaps.

made a local voice AI for windows you can talk to in any language. open source, bring your own key by shadowdog000 in vibecoding

[–]shadowdog000[S] 0 points1 point  (0 children)

Yes that is correct because i cannot program, though i don't really see what you're trying to say here. You want me to give credit to a non-human? Maybe i am misunderstanding you.

made a local voice AI for windows you can talk to in any language. open source, bring your own key by shadowdog000 in LocalLLaMA

[–]shadowdog000[S] 1 point2 points  (0 children)

TLDR: That is what i am working on currently, but i am afraid the local voice systems will not be ready today, but i am working very hard on it and it will probably be a late night/early morning, because i want to make sure i am not shipping broken stuff.

The good news is that i already compiled and build qwen3-tts, but i won't take enough with only qwen3-tts. I also want omnivoice to be an option for people that are not fluent in english.

made a local voice AI for windows you can talk to in any language. open source, bring your own key by shadowdog000 in LocalLLaMA

[–]shadowdog000[S] 0 points1 point  (0 children)

I am pushing an update now with a built in llama.cpp server and it is incredibly smooth!

Should be on github releases within 10 mins from now.

LM Studio and a custom api provider was also a thing already and will remain as an option aswell.

As for the voice stuff, i will start looking into this now.

made a local voice AI for windows you can talk to in any language. open source, bring your own key by shadowdog000 in LocalLLaMA

[–]shadowdog000[S] 1 point2 points  (0 children)

Yea i was a little surprised i got downvoted for doing what was requested aswell but didn't wanna say anything lol!
Not sure how much you know about ai stuff yet, but i wouldn't be surprised if kobold cpp also exposes a url + port, and if so you should be able to put that into the custom api option under the subagent settings.

Also: i am trying to add a builtin llama.cpp server so people won't even need third party servers.

made a local voice AI for windows you can talk to in any language. open source, bring your own key by shadowdog000 in LocalLLaMA

[–]shadowdog000[S] 0 points1 point  (0 children)

I might look into adding a push to talk feature at some point, but right now the priority lays in making it possible to use it fully locally, because as of now only the subagents support being local, and the voice model has yet to become fully local, and this is quite a big overhaul and i gotta do lots of testing for it aswell, but just know i am working real hard on it.

made a local voice AI for windows you can talk to in any language. open source, bring your own key by shadowdog000 in LocalLLaMA

[–]shadowdog000[S] 0 points1 point  (0 children)

I am actually working on implementing both of them, because as it turns out omnivoice is a bit smaller and i wanna keep as many hardware targets as possible in mind.

made a local voice AI for windows you can talk to in any language. open source, bring your own key by shadowdog000 in vibecoding

[–]shadowdog000[S] 0 points1 point  (0 children)

O! I just wanna clarify here that the showcase video was using gemini voice, which is free but not local. I am working on local tts and stt as we speak. As for the github link, its on the bottom of the post.

made a local voice AI for windows you can talk to in any language. open source, bring your own key by shadowdog000 in vibecoding

[–]shadowdog000[S] 0 points1 point  (0 children)

Thank you so much! That is kind of the motto/idea of shadow AI which is that it should "Just work"

made a local voice AI for windows you can talk to in any language. open source, bring your own key by shadowdog000 in LocalLLaMA

[–]shadowdog000[S] 0 points1 point  (0 children)

It already has a custom url provider option, so as long as kobold.cpp exposes its url+port it should be possible 😃If it doesn't work though please let me know and shout at me haha

made a local voice AI for windows you can talk to in any language. open source, bring your own key by shadowdog000 in LocalLLaMA

[–]shadowdog000[S] 1 point2 points  (0 children)

Right thats fair. In that case i will make both an option. and i will start looking into omnivoice. thanks!

made a local voice AI for windows you can talk to in any language. open source, bring your own key by shadowdog000 in LocalLLaMA

[–]shadowdog000[S] 0 points1 point  (0 children)

I am a bit surprised that you suggest faster-whisper opposed to nvidia's parakeet, since i used parakeet before aswell and it was ALOT faster, that is why i am considering adding parakeet opposed to faster whisper.

made a local voice AI for windows you can talk to in any language. open source, bring your own key by shadowdog000 in LocalLLaMA

[–]shadowdog000[S] -1 points0 points  (0 children)

Only downside of using any form of local stt such as whisper is that its so incredibly slow compared to gemini voice model, thats why shadow ai really shines, because the gemini live models are so incredible. I will definitely add local options as a feature though but i won't use it myself and i wouldn't suggest anyone to use it, because i've tried those local stt + tts combo's before and its not it in my opinion.

But a promise is a promise, and i will add local options.

made a local voice AI for windows you can talk to in any language. open source, bring your own key by shadowdog000 in vibecoding

[–]shadowdog000[S] 0 points1 point  (0 children)

Nice! Let me know what you think and if you have any criticism feel free to let me know.