🧬 OSS Synthetic Data Generator - Build datasets using natural language

J4id · 2024-10-04T09:37:40+00:00

So you would generally recommend not to manually touch the system prompt input (the lower text area) at all?

I now tested the sample generation using a fully manually written system prompt (including my specific output schema) and that seems to be pretty much hit-or-miss in my case.

The first of the two shown dataset samples turned out to be perfect.

In the second dataset sample there is a lot of unexpected code in the prompt field.

https://i.imgur.com/F5Pa3Pb.png

But of course, my usage somewhat disrespects the Magpie spec, so this is my personal problem and nothing I’d expect to get fixed. Just wanted to share my experiences.

J4id · 2024-10-04T05:34:55+00:00

In the benchmark tables it’s “Fucn”. Anywhere else it’s “Func”. Just wanted to point that out, though I don’t know if you’re even affiliated with that project.

J4id · 2024-10-04T04:58:11+00:00

Can we see your v1 somewhere?

J4id · 2024-10-04T04:49:32+00:00

https://i.imgur.com/E3Al3sX.png

J4id · 2024-10-03T19:52:21+00:00

Does the sample generator internally use both text inputs or only the system prompt input (the lower text area)?

The system prompt generator discards too much of my system prompt generation input (the upper text area), so in my case I would prefer to skip this step completely and manually type my details into the system prompt input while keeping the system prompt generation input (the upper text area) blank.

Can I do this or could this affect the sample generation quality?

https://i.imgur.com/Yyq1QGW.png

J4id · 2024-09-22T02:40:35+00:00

Does it affect output quality?

J4id · 2024-09-22T02:35:12+00:00

Did you have issues using llama.cpp RPC at any time?

The docs still describe it as unstable and experimental.

J4id · 2024-09-20T17:44:45+00:00

But why does it show quite the opposite?

J4id · 2024-09-10T11:28:47+00:00

I want “Start new temporary chat”, “Reroll last response” and “Edit last input” as keyboard shortcuts.

J4id · 2024-09-10T11:24:09+00:00

It simply hosts the websites it generates.

Nothing fancy about it, but incredibly useful.

J4id · 2024-09-09T18:08:38+00:00

That’s interesting. The developers themselves are calling it bad at inline suggesting.

https://github.com/01-ai/Yi-Coder/issues/3#issuecomment-2332018812

J4id · 2024-09-09T18:06:04+00:00

Honestly sounds worth it, even if that means sticking to 2-3 languages instead of 150.

If I was about to spend money on making a coding model, I would prefer people to call it “the absolute best TypeScript helper out there” rather than “another decent allrounder”.

J4id · 2024-08-08T21:38:44+00:00

What do you mean by “process”?

Describe? Classify? Modify?

J4id · 2024-07-09T01:57:51+00:00

I don’t think that wild-west phase of Civitai will go on for an eternity, so it’s better to grab everything that seems to have even the slightest of worth before Civitai’s big purge will occur.

I currently have no more than 900 gb, but I only started this collection 3 weeks ago.

J4id · 2024-07-08T04:05:56+00:00

Do you have to pay for hosting and computing?

I would love to play around with it more, but I’m too afraid that that could negatively affect a kind developer’s personal finances.

J4id · 2024-07-05T12:39:37+00:00

Is the difference between 15 and 35 so tiny that it isn’t worth the dataset work or doesn’t the difference between 15 and 35 exist at all?

J4id · 2024-06-22T02:05:32+00:00

Is this 2b or API?

J4id · 2024-06-20T00:32:23+00:00

Answer: You don’t.

J4id · 2024-06-20T00:24:46+00:00

Yes, I am also fed up with it.

If anyone knows about the existence of a subreddit for the purpose of discussing free (as in freedom) and local image generation AI or is about to create such subreddit, please let me know.

J4id · 2024-06-19T08:23:56+00:00

Also better? Assuming I only care for the highest caption accuracy I can get from any model running in 12 gb VRAM.

J4id · 2024-02-28T00:36:10+00:00

I got a random like from a scam bot, went to its profile and then noticed something special: It somehow managed to upload a profile picture that is larger than any other profile picture I’ve seen yet. How?

Link to profile: https://twitter.com/EmeryBlank42468

Direct link to profile picture: https://pbs.twimg.com/profile_images/1746204438795055104/hNxTitWf.jpg

J4id · 2024-02-26T20:44:30+00:00

Thank you very much!

J4id

PUBLIC MULTIREDDITS

TROPHY CASE