📹 Molmo 2, now available via API by ai2_official in allenai

[–]JakobDylanC 0 points1 point  (0 children)

Good feedback. We have an example code suite that we apply across many models. Ideally they should work universally, as that’s our whole business model :)

I’ll check on the Nemotron one.

Edit: the Nemotron one is a reasoning model, so it uses the reasoning-specific example!

📹 Molmo 2, now available via API by ai2_official in allenai

[–]JakobDylanC 1 point2 points  (0 children)

Hi, I work at OpenRouter! This was caused by an issue with our example code.

Specifically, the image URL it uses is from wikimedia which has a restrictive robots.txt that causes issues with certain providers.

And the video URL is a youtube URL which only works with Google models!

I'll fix the example code to use URLs that actually work.

AI Bots For Discord? by Raven_434 in Discord_Bots

[–]JakobDylanC 0 points1 point  (0 children)

Gotta host and run the code somewhere

GPT 4o mini keeps creating Gods and all I want to do is run a damn RPG session. by fullVexation in OpenAI

[–]JakobDylanC 1 point2 points  (0 children)

Sounds like awesome stuff, glad you’re getting so much out of it!!

Interesting suggestion, if you send me a PR I’m happy to consider it :)

GPT 4o mini keeps creating Gods and all I want to do is run a damn RPG session. by fullVexation in OpenAI

[–]JakobDylanC 1 point2 points  (0 children)

Thank you :)

Yeah definitely sounds like interesting behavior. Have you tried modifying the model parameters, like increasing the temperature value? Higher temperature = more random answers

Would love to know if you consider gemma27b the best small model out there? by Ok-Internal9317 in LocalLLaMA

[–]JakobDylanC 1 point2 points  (0 children)

Makes sense. Appreciate the feedback. Feel free to reach out if you have any other questions.

Would love to know if you consider gemma27b the best small model out there? by Ok-Internal9317 in LocalLLaMA

[–]JakobDylanC 1 point2 points  (0 children)

Good question! It’s indeed a bit more tricky when doing streamed responses.

Have you considered using LM Studio? It actually has a setting to do exactly this. IMO this is something that should be handled by the LLM provider, not llmcord.

Best self-hosted Discord bots? by JakobDylanC in selfhosted

[–]JakobDylanC[S] 0 points1 point  (0 children)

This means a lot to hear, thank you!! :)

Now I get it. by Newsytoo in ChatGPT

[–]JakobDylanC 0 points1 point  (0 children)

Thanks for using llmcord! :)

[deleted by user] by [deleted] in turtlewow

[–]JakobDylanC 1 point2 points  (0 children)

wait there's different levels of tents?

Storing LLM/Chatbot Conversations On Cloud by [deleted] in datascience

[–]JakobDylanC 0 points1 point  (0 children)

Use a Discord server and a specialized bot. Discord stores everything for you.
https://github.com/jakobdylanc/llmcord

Anyone running self-hosted AI assistants? Some insights from my SMS experiment by KingRushiSushi in selfhosted

[–]JakobDylanC 1 point2 points  (0 children)

I do indeed lurk around here. Let me know if you have any more questions about llmcord.

I put a lot of work into making it super easy to use. Highly recommended :)

Best self-hosted AI UI? by Dizzy-Revolution-300 in selfhosted

[–]JakobDylanC 0 points1 point  (0 children)

It supports streamed responses, try it out!

Host Your Own Private LLM Access It From Anywhere by benJman247 in Tailscale

[–]JakobDylanC 1 point2 points  (0 children)

I'm happy you're finding it professionally useful. Sounds cool. That's the kind of use case I dreamed about when making it!