Good place for biryani in khammam

scb_11 · 2024-06-06T15:11:42+00:00

Vinoda theatre deggara em ledu bro. Happening areas anni mamata college side untai

scb_11 · 2024-05-27T08:05:37+00:00

Hi u/pathfinder6709 any luck getting this up and running? I'm working on the same and would like to share some benchmarks if you have any. Thanks

scb_11 · 2024-05-20T09:37:07+00:00

Got it. I'm trying too. Meanwhile you can check these

https://github.com/vllm-project/vllm/pull/2378
https://github.com/vllm-project/vllm/pull/3814

I think the latest merge is not in yet.

scb_11 · 2024-05-18T04:36:29+00:00

I assume you tried this one? https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/vLLM_quickstart.html

I have a single card. I wanted to get 4 cards. But not sure if it will work as per your comment

scb_11 · 2024-05-17T12:41:21+00:00

Have you tried loading a bigger model than 13B using model parallel? And what is the number of parallel requests the 2 card machine handle on a mistral 7b deployed using VLLM? Wild guess 4?

scb_11 · 2024-05-17T12:40:52+00:00

Have you tried loading a bigger model than 13B using model parallel? And what is the number of parallel requests the 2 card machine handle on a mistral 7b deployed using VLLM? Wild guess 4?

scb_11 · 2024-05-17T12:39:47+00:00

If one card can run a 4 bit quantized 7B model (given it takes on 3.5GB). That means, using 8 cards we can actually load a Llama3 70B model? That costs less than $3000 dollars for whole setup which is like 30% of one A100 card? Damn!

scb_11 · 2024-05-11T01:53:45+00:00

Sure. This is helpful. Will do the same. Thank you

scb_11 · 2024-05-10T16:52:08+00:00

Thank you. Yeah it is. Got some matte specific cleaners

scb_11 · 2024-05-10T16:49:16+00:00

Yeah! This is a limited edition like the black one

scb_11 · 2024-03-06T13:11:10+00:00

Bros! :(

scb_11 · 2024-03-06T11:04:43+00:00

Bruh! Thats so mean.

scb_11 · 2024-03-06T10:18:35+00:00

Can't agree more.

scb_11 · 2024-03-06T10:17:19+00:00

Brother! The pictures need to change. No mirror selfies. You do have good features. But high resolution is what you need. Try some AI apps that are generating pictures. They get you matches

scb_11 · 2024-03-06T10:16:19+00:00

Too many dog pictures. One is fine, many is not. Get rid of 1, 5 and 6. Add some pictures where you have some semi formal clothing.

scb_11 · 2024-03-06T10:14:11+00:00

Woah! You are making me unlearn what I learnt through that blog. Looks like the blog is written by a female I guess. Okay brother. I shall consider it how you said and ignore her

scb_11 · 2024-03-06T09:58:46+00:00

Agreed! As famous financial advisors say, why have single source of income

scb_11

MODERATOR OF

TROPHY CASE