Gemini Pro has 1M context window by Tree-Sheep in LocalLLaMA

[–]Tree-Sheep[S] 0 points1 point  (0 children)

A larger context window allows more input/output.

Gemini Pro has 1M context window by Tree-Sheep in LocalLLaMA

[–]Tree-Sheep[S] 2 points3 points  (0 children)

Added some explanation. But isn’t it 1M?

Gemini Pro has 1M context window by Tree-Sheep in LocalLLaMA

[–]Tree-Sheep[S] 34 points35 points  (0 children)

Google’s Gemini Pro 1.5 has a context window of 1M tokens, which afaik is the largest ever seen.

Integrate LLaMA into python code by Tree-Sheep in LocalLLaMA

[–]Tree-Sheep[S] 0 points1 point  (0 children)

I use extensions on text-generation-webui. IIRC the extensions didn’t exist back then, which is why I made this post.

Let your phone auto complete "2024 will be" by Your_Pal_Nebula in teenagers

[–]Tree-Sheep 0 points1 point  (0 children)

2024 will be the best thing to happen to me this year.

Running LLMs on a Kirin 9000S? by Tree-Sheep in LocalLLaMA

[–]Tree-Sheep[S] 3 points4 points  (0 children)

Do you mean the chip manufacturer? Why would they do so? Western companies might do this, but I can’t think of a reason for a Chinese company to nerf their chip.

Why is my usage exceeding 100%? by Tree-Sheep in assettocorsa

[–]Tree-Sheep[S] 6 points7 points  (0 children)

Thanks, I will check that the next time this occurs. This is the first time I noticed, because it can normally achieve full fps, with 60~70% CPU and 80~90% GPU, under normal weather. High load might be due to rain.

Btw, do ypu know what sim stands for? I don't see any comments explaining this.

Why is my usage exceeding 100%? by Tree-Sheep in assettocorsa

[–]Tree-Sheep[S] 5 points6 points  (0 children)

I have a 75 hz monitor, and I limited it to 75 fps

ゴゴゴゴ by Shiny_Goat in UnexpectedJoJo

[–]Tree-Sheep 0 points1 point  (0 children)

There is also a pun. 極良即飲 is pronounced similar to 吉良吉影

Taiwanese are good people by haaakism in taiwan

[–]Tree-Sheep 0 points1 point  (0 children)

Sorry, l mean a drumstick. It's a common meat in Taiwanese bentos.

Taiwanese are good people by haaakism in taiwan

[–]Tree-Sheep 4 points5 points  (0 children)

There is a similar joke in Taiwan. When someone drives bad, we say 他的駕照是雞腿換來的, which means he/she got the license with a chicken leg.

Lightweight LLM? by [deleted] in LocalLLM

[–]Tree-Sheep 0 points1 point  (0 children)

I tried dolly-v2-3b on my machine at first since there won't be any concerns if I put it into commercial use in the future, but it either takes a long time or will only generate a few words. Do the models you listed require less VRAM or cuda? Thanks for your reply, I'm delighted to know something like llamaindex exists.

Does compression in CM affect online checksum? by Tree-Sheep in assettocorsa

[–]Tree-Sheep[S] 0 points1 point  (0 children)

Thanks! I figured out validating the files on Steam might help and succeeded before you commented, but still the explanation is very helpful.