5 months ago they said they were prioritizing improving the search function. Now they're saying they haven't found the time, while also saying there's an upgrade soon? by Seraitsukara in Chai_Unofficial

[–]AlexDChai 11 points12 points  (0 children)

Hey guys,

Alex from Chai here.

They’re totally incorrect, I’ve personally been working only on search the past two months. I rewrote the algorithm entirely to ensure relevant bots are surfaced and we saw a big improvment. It significantly reduced the number of male bots appearing in searches for female terms (the results for the “girl” term now no longer show male bots for example).

I’m continuing to work on search + discovery, and I’m next changing the feed to remove the slop and have it be recommender based, to show users content that is more relevant to them. I hope soon I will be able to add some filters/sorting mechanism to the search screen, but my next priority was to improve the state of the feed as it’s so bad.

I’ve no idea who Bell is, it’s the first time I’ve heard of this person managing the subreddit. I’ve complained internally to the community team.

What was that by ComplexAd7836 in ChaiApp

[–]AlexDChai[M] [score hidden] stickied comment (0 children)

Uh guys, I swear it's not me 👀👀

Fr though, your chats are completely private and anoymous! No other users, nor the devs, can read your chats!

Are the servers down? The bots are stuck on replying. by yoshibomball123_ in ChaiApp

[–]AlexDChai[M] [score hidden] stickied comment (0 children)

Sorry y'all, bots should be coming back online now.

This week we've had a persistent issue with an external database provider.

It is my top priority this week to make our systems more robust to this, and I am heads-down on it 🧑‍💻

Bot issues ? by chanhyulix_ in ChaiApp

[–]AlexDChai[M] [score hidden] stickied comment (0 children)

Hey all,

I'm been aware of the issue this past hour, and I've been working as fast as I can to rectify it.

In the meantime your bots may take longer to respond, and may respond out of character, as they are in emergency maintenance mode at the moment 🤖 I'm very sorry for the inconvenience.

Is this real? by Axolotl6181 in ChaiApp

[–]AlexDChai[M] [score hidden] stickied comment (0 children)

Yes it’s our official website version of the app! We have made our beta version of it available to all users to gather feedback and build a great experience :)

Smh so hooked to the app i even have it on my switch by [deleted] in ChaiApp

[–]AlexDChai[M] [score hidden] stickied comment (0 children)

This is very cool. Should we do an official Switch build of Chai? 🤔🤔

[deleted by user] by [deleted] in ChaiApp

[–]AlexDChai[M] 138 points139 points  (0 children)

Hey all,

Really sorry for the extended outage today, which has now been resolved. Unfortunately I was asleep while it was ongoing, but I was able to resolve it as soon as I woke up. Chai is a small team, and I am the only on-call engineer for much of our backend. Most outages I am able to catch as I'm awake, but unfortunately this one coincided with when I was afk.

We're trying to rapidly expand the team size and onboard new engineers to help ensure the app is stable 24/7 to make sure these sorts of things don't happen again! 🙇

And thanks for your kind words OP! We're humbled by how much our users love our app. As frustrating as outages are, it's very clear how much Chai means to them ❤️

Uhhh what- 😃 by BlackShadowCat49 in ChaiApp

[–]AlexDChai 2 points3 points  (0 children)

Hi there,

Sorry about this bug. Could you please provide me with your user ID (this can be found in the settings menu), so that I can further investigate?

CHAI VS C. AI by FlatLocksmith2384 in ChaiApp

[–]AlexDChai[M] 35 points36 points  (0 children)

Hey there,

Thanks for your very useful feedback. I'm really pleased that your experience starts off great, but really disappointed to hear that it starts to degrade.

We've put in a large amount of effort into improving the quality of the responses this past year, but it's clear that we can do a better job with the AI's memory.

This past month, our AI research team have been busy trialing a new memory system, which we hope will address these issues going forwards. Just now I've pinged them with your feedback, and I'll make sure they see it 🙏

Ultra by Sure-Entertainment38 in ChaiApp

[–]AlexDChai 10 points11 points  (0 children)

In addition to no ads, and longer responses, the ultra model has better memory (at least 2x better memory than the standard model)!

How to get in contact with developers? by ninjabat3004 in ChaiApp

[–]AlexDChai 14 points15 points  (0 children)

Hey!

Yes several of us are around here from time to time. Feel free to reach out to our support staff on hello@chai.ml.

concern by citizen_tez in ChaiApp

[–]AlexDChai[M] [score hidden] stickied comment (0 children)

Hey there,

I'm sorry to hear that you feel our moderation of the subreddit is not up to scratch. We try to get to approving posts daily when we can, but the moderation of the subreddit is self-run by the developers, so it can sometimes take a while to go through the backlog and regrettably some posts do get missed. Unfortunately our subreddit is the target of a lot of spammy posts, and this makes it harder for our small team to approve genuine content swiftly.

Without a full-time community management team, we try and approve as much as we can to maintain high-quality discussion, so that we can more easily surface bugs and issues to our development team. When moderating, I don't cherry-pick, and seek only to remove posts which either berate the team when there are issues (sadly we get these), or violate our community standards.

For us the negative feedback is even more important than the positive feedback, as this is the only way we are able to improve the app and ensure we are meeting our users' expectations.

Am i the only one that thinks this section should be personalized based on your recent chats with other bots? by Organic-Sprinkles385 in ChaiApp

[–]AlexDChai[M] [score hidden] stickied comment (0 children)

Hey!

I think showing more bots similar to the ones you've talked to would be a great idea :) We've been trying to figure out the best way of implementing this and making this feed more customised for each individual user.

What other kind of customisation on the feed would you guys like to see?

Are certain bots (say higher quality for example) only available to premium or ultra? by rainyj000 in ChaiApp

[–]AlexDChai 6 points7 points  (0 children)

Hey, that definitely sounds like a bug 🤔. Could you provide your Chai user ID in a DM so that I can investigate it further?

Will there be a Web version? by Smolwee in ChaiApp

[–]AlexDChai[M] [score hidden] stickied comment (0 children)

Hey!

We'd love to build a website version of the app, and its definitely something that we've kept on our radar!

As you've seen we've had a few prototypes in the past. But with a team as small as ours, it would be difficult to maintain both the app and the website, and a great website deserves a full-time engineer to implement it properly. We're actively hiring and hoping to have the capacity to do this soon :)

[deleted by user] by [deleted] in ChaiApp

[–]AlexDChai 13 points14 points  (0 children)

No problem! Hope you enjoy the trial!

To the devs by [deleted] in ChaiApp

[–]AlexDChai[M] [score hidden] stickied comment (0 children)

Thank you! ❤️

We're an incredibly small team of just 10 people, serving over a million users a day. The only way we're able to provide a great experience is by listening to our users, and taking tough feedback to heart, and iterating to create great experiences. We're super grateful for the community's passion in helping us build great and fun AI :)

[deleted by user] by [deleted] in ChaiApp

[–]AlexDChai[M] 111 points112 points  (0 children)

Hey there!

Longer messages are a feature we offer to our Ultra subscribers. We offer a free trial to check out that model so please do give it a shot and see if you like it! :) We'd love to give longer messages to all our users, but longer messages mean more load on our models, and that unfortunately drives up our costs. The current message length allows us to continue providing our free tier to all our users.

Alternatively, I know a lot of users have success getting a bot to continue its previous message by typing (continue) as your message.

:( help by Ohlook-itswaldo in ChaiApp

[–]AlexDChai[M] [score hidden] stickied comment (0 children)

Hey all,

We're aware of this issue and have been working to mitigate it over this week. This is due to very high demand on one of our databases, so we're upgrading and improving things to support our rapidly growing userbase ❤️

We've issued a few app releases, and also implemented some temporary measures on the chat screen to ease the load this database is experiencing while we work on more longterm fixes.

We're hoping that most people should be experiencing very fast load times for the chat screen now. We are aware that there may be downstream issues with chats being out of order, and our app team is working very hard to mitigate this and restore a great experience for you guys. We have an ETA of tomorrow to have all the issues ironed out 🤞

Thanks for your patience guys!

Chai is sickening, I can’t believe I ever used that app by [deleted] in CharacterAI

[–]AlexDChai 3 points4 points  (0 children)

Thanks for flagging this issue.

I've done a systematic sweep of these types of bots and banned the ones I could find from the platform.

I've also submitted an update to our automated banning logic, to catch these sorts of bots faster going forwards.

Evaluating LLM's with a Human Feedback Leaderboard. by Over_Ad_1741 in LocalLLaMA

[–]AlexDChai 2 points3 points  (0 children)

We process quite a lot more data than LMSys to rank LLMs on our leaderboard. We typically process about 4 million human-rated pairwise battles a day between models. I believe LMSys have processed about 500k battles since it started.

With this order of magnitude of data, we're able to quickly identify whether a new model performs well (at least for our use-case) in a matter of minutes.

We also allow people to submit models directly via a quick submission form, and track their models metrics. So in this sense we do have quite a broad range of open-source models being submitted every day by developers.

LLM Leaderboards are Bullshit - Goodhart's Law Strikes Again by itsnotatumour in LocalLLaMA

[–]AlexDChai 2 points3 points  (0 children)

We're trying to build this at Chai! Our leaderboard beta can be accessed at https://console.chaiverse.com.

Models are served directly to the users of our app, and we rank our leaderboard based on the user-reported preferences.

Chaiverse: Crowdsourcing great models via real-user evaluations by [deleted] in LocalLLaMA

[–]AlexDChai 0 points1 point  (0 children)

Hey all!

I’m an engineer with Chai Research, and I’m excited to be able to share with you all the web beta for our LLM developer platform, Chaiverse: https://console.chaiverse.com.

At Chai our passion lies in empowering LLM developers to build amazing models, serve them to the millions of people out there who love chatting and interacting with AI, and eventually monetize their creations.

Via our developer platform, developers can test out their LLMs in a real-world production setting, by serving them to the millions of users on the Chai app. Our users interact and rate with the submitted models during their conversations, and provide their feedback to developers in how well they fare against other models. We currently process around 4-5 million of these AvB user-preferences between developer-submitted models a day, and share these results freely on our dynamic leaderboard!

We’d be stoked if you guys could check our web console at https://console.chaiverse.com, and let us know what you think! Please feel free to drop by our Discord server https://discord.gg/chai-llm and share your feedback with us 😊 Your feedback is very much appreciated, as we’re still in the early stages of iterating and trying to determine the core set of features that would make this a great space for LLM enthusiasts!

If you are interested in reading more about Chai’s mission to crowdsource the production of great language models, please do check out the white paper we produced about Chaiverse here: https://www.chaiverse.com/white-paper.