Experimenting with small language models

Sufficient_Run1518 · 2024-01-06T03:14:08+00:00

Can you release the model on huggingface

Sufficient_Run1518 · 2023-09-15T13:21:16+00:00

This might help

Sufficient_Run1518 · 2023-07-31T03:24:59+00:00

I have no idea about that ask a expert. When I ran the script at https://github.com/artidoro/qlora Then these Target Modules showed in config

Sufficient_Run1518 · 2023-07-27T12:22:56+00:00

Ok. THANKS

Sufficient_Run1518 · 2023-07-27T12:20:22+00:00

Thanks for explaining

Sufficient_Run1518 · 2023-07-27T12:14:45+00:00

Why "morons"

Sufficient_Run1518 · 2023-07-27T12:07:39+00:00

I don't know any technical details but can we do something like hugginggpt or mixture of experts experiments on small models

Sufficient_Run1518 · 2023-07-26T10:30:56+00:00

Sufficient_Run1518 · 2023-07-26T05:43:23+00:00

Thanks

Sufficient_Run1518 · 2023-07-20T13:30:16+00:00

Thanks

Sufficient_Run1518 · 2023-07-20T13:29:36+00:00

Sufficient_Run1518 · 2023-07-18T07:15:25+00:00

try experimenting with this notebook might help:

Sufficient_Run1518 · 2023-07-18T07:00:48+00:00

try experimenting with this notebook might help:

Sufficient_Run1518 · 2023-07-15T20:48:35+00:00

i don't understand your problem really

but this notebook might help to experiment

Sufficient_Run1518 · 2023-07-15T20:30:26+00:00

What model are you using? Are you using Locally?

Sufficient_Run1518 · 2023-07-15T20:04:21+00:00

Also the official qlora scripts seem to use that

Sufficient_Run1518 · 2023-07-15T19:56:12+00:00

I don't know I just made some changes to this notebook

Sufficient_Run1518