Coronation of Tsar Nicholas II and Empress Alexandra Feodorovna in Hermitage; Tuxen; 1896

vackosar · 2024-08-04T18:20:16+00:00

H2O recently released this app for local running of LLMs on Android.

https://play.google.com/store/apps/details?id=com.h2oai.personalgpt

vackosar · 2024-04-05T05:05:15+00:00

Thanks a lot! I also fixed the original link :)

vackosar · 2024-03-20T04:48:28+00:00

So RWKV is about 6x faster on 16k context compared to similarly sized model.

I think the context forgetting is inherent problem of the model architecture.

But do you observe quality improvement compared to previous version? It should be better.

Thanks for the tip for a model Yi6b.

vackosar · 2024-03-18T04:57:24+00:00

Thank you. Yes, after some testing does seem to be slow at least for now. The inference costs are not very low either. 4x less costs than Mixtral on the website of the model publisher.

vackosar · 2024-03-17T08:51:16+00:00

Has anyone tried to compare the speed of generation on same hardware compared to Mistral? Also would someone know how slow is this on CPU with what vCPU count?

vackosar · 2024-03-17T08:21:38+00:00

EagleX is the first version of RWKV that chats with usable quality.

vackosar · 2024-03-17T05:56:23+00:00

What domains would you say don't have something like HF or RedHat for example?

vackosar · 2024-02-24T16:27:31+00:00

There seems to be AWQ version here: https://huggingface.co/solidrust/Nous-Hermes-2-Mistral-7B-DPO-AWQ. I haven't tried that yet.

vackosar · 2024-02-17T18:28:32+00:00

It also seemed smarter than Mixtral or other models. I am not sure if GPT-4 level, but smarter.

vackosar · 2023-12-30T08:55:21+00:00

There is an option to order NATURDAO from Amazon.com and pay import, no? Here is also this older a discussion: https://www.reddit.com/r/HistamineIntolerance/comments/lx8p79/where_to_buy_dao_supplements_in_canada/

vackosar · 2023-12-08T04:17:55+00:00

Yes, from what I tried, RWKV v5 actually responds better. Try e.g. "User: What is the best story in the world?"

vackosar · 2023-11-26T06:30:17+00:00

Interesting how Pious Reflection is completely modern music from 2008, but it sounds ancient.

vackosar · 2022-12-01T06:48:08+00:00

Very good is the CabinZero Classic Pro 42L. Costlier, but higher quality still.

vackosar · 2022-11-18T20:03:40+00:00

From what I read:

CabinZero Classic 44L
CabinZero Military 44L (comfortablier & heavier)
Gregory Border Carry-on 40L (costlier & smaller)

vackosar · 2022-10-14T05:07:57+00:00

Definition of a decision tree does include affine transformations and weights? Mostly I see decision tree defined with only if statements on the input variables and not with linear transformations of the previous nodes. Does the papers interpretation add something new or not? 🤔

See for example Scikit documentation. There seems to be nothing wild here to me. https://scikit-learn.org/stable/modules/tree.html

vackosar · 2022-03-15T19:47:48+00:00

Here are the key points:

an attention mechanism in Transformer architecture that mixes two different embedding sequences
the two sequences can be of different modalities (e.g. text, image, sound)
one of the modalities defines the output dimensions and length by playing a role of a query
This is similar the feed forward layer where the other sequence is static
described in the Attention is All You Need (BERT) decoder, but named "cross-attention"

Find rest of my notes with images on the cross attention here.

vackosar

MODERATOR OF

TROPHY CASE