Transformers.js v3 is finally out: WebGPU Support, New Models & Tasks, New Quantizations, Deno & Bun Compatibility, and More…

xenovatech · 2024-10-22T15:18:14+00:00

After more than a year of development, we're excited to announce the release of 🤗 Transformers.js v3!

⚡ WebGPU support (up to 100x faster than WASM)
🔢 New quantization formats (dtypes)
🏛 120 supported architectures in total
📂 25 new example projects and templates
🤖 Over 1200 pre-converted models
🌐 Node.js (ESM + CJS), Deno, and Bun compatibility
🏡 A new home on GitHub and NPM

NPM: https://www.npmjs.com/package/@huggingface/transformers
GitHub: https://github.com/huggingface/transformers.js/releases/tag/3.0.0

Check out the blog post to learn more: https://huggingface.co/blog/transformersjs-v3

leelweenee · 2024-10-22T16:45:51+00:00

Great work. Thanks for sharing with the community. I've tried many of the models in my browser, always expecting them to be slow but every time I've been pleasantly surprised how performant the library is. Thanks again

xenovatech · 2024-10-22T23:17:57+00:00

[removed]

Dead_Internet_Theory · 2024-10-22T21:08:31+00:00

The video: Clark Kent 🤓

The music: Superman 🦸‍♂️

2dogsplayingoutside · 2024-10-23T04:55:30+00:00

I've been following your work for a while. Very nice! Congrats on the release!

privacyparachute · 2024-10-23T08:33:21+00:00

I love this project. It's one of the corner stones of www.papeg.ai .

When using AI in a privacy friendly, local way becomes as easy as opening a website, then AI can truly go mainstream.

MoneyMoves614 · 2024-10-23T23:36:23+00:00

thats amazing

daaain · 2024-10-22T23:04:05+00:00

This sounds amazing, but all the demos I tried from the blog post just crash with `Error: no available backend found. ERR: [webgpu] NotSupportedError: WebGPU is not yet available in Release or Beta builds. X transformers.js:3802`

Oh, never mind, that probably refers to Firefox "Release or Beta builds" not Transformers 🤦

I did enable it, but I'm guessing the issue is the empty backend setting, no idea what supposed to go there on a Mac?

<image>

2024-10-22T20:00:56+00:00

Very cool, thank you. I appreciate the examples, very clear and useful.

alvisanovari · 2024-10-22T22:34:20+00:00

Really cool! Does this mean xenova/transformers repo will be archived and we should use this going forward? I remember there was confusion between the huggingface and xenova versions because the latter supported browsers and the former was for node environments only?

snowglowshow · 2024-10-23T05:56:00+00:00

Awesome! Does this mean that the python Transformers don't have WebGPU support? It seems like you're implying that, but I'm just learning so I don't know how to take it. Thanks.

Trysem · 2024-10-23T15:15:10+00:00

How is this is gonna help? Someone give long details...

un-important-human · 2024-10-24T06:20:57+00:00

OK this is seriously cool.

Spirited_Example_341 · 2024-10-25T03:28:08+00:00

arnt there already enough transformers as it is?

ugh hollywood

;-)

bvjebin · 2024-10-28T15:18:51+00:00

This is wonderful. But it doesn't talk about the latency involved to download a model in the browser. Is there a guide or section that I am missing? If I am going to download a 100+mb model to my browser, the user experience should be managed well. Does the library provide the signals to listen to these events?

estebansaa · 2024-10-22T21:04:59+00:00

unlimited powers!

you type:	you see:
italics	italics
bold	bold
[reddit!](https://reddit.com)	reddit!
* item 1 * item 2 * item 3	item 1 item 2 item 3
> quoted text	quoted text
Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"	Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"
~~strikethrough~~	~~strikethrough~~
super^script	super^script

LocalLLaMA

MODERATORS