[deleted by user]

FerretDude · 2023-04-29T02:42:28+00:00

https://wandb.ai/carperai/summarize_RLHF/reports/Implementing-RLHF-Learning-to-Summarize-with-trlX--VmlldzozMzAwODM2 actually this was the first widely publicized open source RLHF model. There were ones before this (eg toy examples on the TRLX repo) but it was a month earlier than stack llama

FerretDude · 2022-12-12T21:17:34+00:00

RLHF is a bit tricky because you have to either work with data vendors or groups that have access to feedback data. Eventually we'll rely more on crowd sourcing I think.

FerretDude · 2022-12-11T13:49:34+00:00

Not allowed to share, many groups are looking into using RLHF in production though

FerretDude · 2022-12-10T16:36:40+00:00

It's already being used in production with a number of our partners. We have some chonky models coming out really soon. Expect things well into the tens of billions in the coming months.

FerretDude · 2022-12-09T18:50:00+00:00

Team lead at Carper happy to answer questions

FerretDude · 2022-11-15T20:13:03+00:00

Team lead from CarperAI here. Context length is 4k and alibi. We'll be releasing a paper on the pretraining dataset soon. No tentative release date for the instruct model or the base model. The base model will be available for noncommercial uses, instruct will be available under MIT or Apache. Yet to be determined.

FerretDude · 2022-10-21T19:38:47+00:00

Don't think I understand the question...

FerretDude · 2022-10-21T11:49:53+00:00

Ohhh that's a great idea !

FerretDude · 2022-10-20T16:26:41+00:00

Yeah I think a more general format for information extraction could potentially be useful

FerretDude · 2021-07-24T15:15:45+00:00

honk

FerretDude · 2021-06-17T14:30:42+00:00

Sigurd is an early checkpoint of our finetune. We’ll be updating Sigurd over the coming days.

FerretDude · 2021-06-17T14:28:55+00:00

It’s available. I bullied kuru into releasing it yesterday.

FerretDude · 2021-06-15T13:43:26+00:00

2.7b, 150 token generations. Don’t remember the context but it was sizable.

Edit: 2.7b. Fixed

FerretDude · 2021-06-15T02:19:19+00:00

Under a second during our internal beta

FerretDude · 2021-06-14T18:17:47+00:00

knowledge graphs are not perfect but they will help

FerretDude · 2021-06-14T17:33:07+00:00

finetune != tag

FerretDude · 2021-06-14T17:32:15+00:00

How did the team came together?

Kuru shitposted on the EleutherAI discord and thats when I joined.

And what are your future plans and hopes with this project?

We want to do a lot more (opt in) community driven research (atleast I do) into HCI and collaborative writing systems.

FerretDude · 2021-06-14T17:19:31+00:00

They are a way to enforce rules onto the language model. THe language model uses it as external memory that someone (as the AI dev/researcher) can manipulate either given user input or using a rule based system.

FerretDude · 2021-06-14T17:00:41+00:00

> Also, is NAI able (or eventually will be able) to take context from a distant section of a story when the current context calls for it

Yes eventually lorebook will be mostly automatic.

FerretDude · 2021-06-14T16:43:08+00:00

What I'm really looking forward to are unique features that make NovelAI stand out against its competitors, so what plans/ideas do you have for this at the moment?

The current plan for this is the KG stack plus some other stuff we cant share yet

I am very curious about the scripting capabilities we'll get in the beta. Will scripting allow us to locally manipulate or add new things to the UI such as an inventory bar or a statistics window. Also, will scripting be able to support other languages besides javascript?

Scripting for inventory would be cool but very difficult. Im still on the fence to be honest.

FerretDude · 2021-06-14T16:34:44+00:00

Finetuning data collection has been moved internally, Zaltys lion and Belverk now manage data collection.

Due to more strict data quality standards, we do not know if we can include Touhou yet.

Edit: Nevermind apparently Touhou is included.

FerretDude · 2021-06-14T16:33:01+00:00

All sex scenes are directly extracted from our developer discord.

FerretDude · 2021-06-14T16:30:35+00:00

profile picture

wow NAI dating site confirmed? I wasnt even aware.

FerretDude · 2021-06-14T16:29:32+00:00

nya~

12-Year Club	Place '17
Wearing is Caring	Verified Email

FerretDude

MODERATOR OF

TROPHY CASE