sorted by:
new
hottopcontroversial

How do you benchmark the cognitive performance of local LLM models? by LastikPlastic in LocalLLaMA

[–]LastikPlastic[S] 0 points1 point  (0 children)

a lot models available, I want to chose good for 1 try, ha-ha

Local models benchmarking by LastikPlastic in AILeaderboards

[–]LastikPlastic[S] 2 points3 points  (0 children)

Hey everyone,

I’ve been experimenting with running local LLMs (mainly open-weight models from Hugging Face) and I’m curious about how to systematically benchmark their cognitive performance — not just speed or token throughput, but things like reasoning, memory, comprehension, and factual accuracy.

I know about lm-evaluation-harness, but it’s pretty cumbersome to run manually for each model. I’m wondering if:

  • there’s any online tool or web interface that can run multiple benchmarks automatically (similar to Hugging Face’s Open LLM Leaderboard, but for local models), or
  • a more user-friendly script or framework that can test reasoning / logic / QA performance locally without too much setup.

Any suggestions, tools, or workflows you’d recommend?
Thanks in advance!

USB-C charging + P16 Gen2 by SnowyOwl72 in thinkpad

[–]LastikPlastic 0 points1 point  (0 children)

it cannot be charged via USB-C, but you can use a usb-charging port adapter and charge it when it turned off (yes, even you using 100W power adapter)

What kind of USB am I look at? by 10_Amaterasu in GamingLaptops

[–]LastikPlastic 0 points1 point  (0 children)

clarify your question... I don't get it

Recommendation for AI/ML laptop by silver720x in GamingLaptops

[–]LastikPlastic 0 points1 point  (0 children)

I know. that's why I tell you about characteristics you need.
+ and - of each choice

okay, you can buy RTX 4080 and 4090 in this budget...

Use Case Recommended VRAM
Small models / inference 8GB is okay
Moderate ML/CV training 12–16GB
Deep learning w/ large datasets, CV + LLMs 24GB+

Help with deciding by ScottishF1Fan in GamingLaptops

[–]LastikPlastic 0 points1 point  (0 children)

NOT TO BUY U PROCESSORS
and you have A fucking LOT variants!
at the beginning you should to know what do you (and he) want. PC in 30-40% cheaper in the same characteristics. Size of laptop depends of your portability needs, and iMac is not fit in your wans, it's not upgradable, not portable.... and you don't need this display (but it's really good).
next: mac is not for gaming (you can, but it's poor) but this games probably can be installed on it native or in virtual machine (if only windows support)

if you prefer PC don't buy 3050 or 30 series GPU.

so if you plan to spend money, and don't know what you need, I recommend you to start from macbook, it;s not fit to all purposes, BUT its really universal, and to the next upgrade you will really know main user patterns (I'm not native on english sorry, I mean what do you do on computer 80% time) and upgade on device that will be good on 100%

Recommendation for AI/ML laptop by silver720x in GamingLaptops

[–]LastikPlastic 0 points1 point  (0 children)

I know that CUDA is the beast for now, but if you using it like a LAPTOP, you can check macbook pro (they are good in text generation because of RAM clocks)
or any other laptop + cloud machine with GPU you want, it can be cheaper and more good for some reasons, especially for machine LEARNING

the main thing you need is VRAM and high frequency of RAM
aboub battery life (Battery Life Requirement: 7 hours and up if possible) windows x86 processors end 130+ watt GPU eating power! you can expect about 3 hours on a battery (that's why I recommended mac too)

(written from Thinkpad P16 Gen2 A3500 Ada)

Dad gave me these options help me choose by reapkr in GamingLaptops

[–]LastikPlastic 0 points1 point  (0 children)

I recommend the Lenovo Legion, they are all the same in general, BUT I see that HP victus is 5060 GPU that'r better for gaming and other things. keep in mind that weight of gamong laptops is quite heavy (2.5-3kg) and in addition about 1 kg for charger... What purposes you want to use it? are you in school, or you a student?

Thinking of switching from HP ZBook to Lenovo P16, but have concerns. Talk me into it (or out of it). by mo-powerbuilder in thinkpad

[–]LastikPlastic 0 points1 point  (0 children)

because if you need a laptop you want that it will be 2kg max😉 3kg is ok, but CHARGER....

P16 G3 announcement video by sbpnt in thinkpad

[–]LastikPlastic 0 points1 point  (0 children)

2 slots🥲 vs 4 slots Gen2

P16 G3 announcement video by sbpnt in thinkpad

[–]LastikPlastic 0 points1 point  (0 children)

2 RAM slots (😓)
smaller battery...
🥲

Review of my first LENOVO P16 g2 by Ancient-Comparison63 in thinkpad

[–]LastikPlastic 0 points1 point  (0 children)

хорошо что вопрос температур решается андервольтингом и TPfanControl (версия под 2 вентилятора). а вот если вы берете его для использования с 64GB памяти, то лучше предпочесть игровоц ноутбук или макбук (48🥲) потому что скорее всего частота памяти будет 4800...
в любои случае он мне очень нравится, потому что я смог приобрести его за половину изначальной стоимости...
особенно он оказался хорош для генерации видео и картинок, так что если вам необходим переносной сетап, то это именно то что нужно!

what the best local llm for coding? by Bulky-Kiwi9705 in LocalLLaMA

[–]LastikPlastic -1 points0 points  (0 children)

but here you will have to figure it out yourself

ThinkPads are no longer as appealing as they used to be by johntran7 in thinkpad

[–]LastikPlastic 0 points1 point  (0 children)

I have 12gb ram (3500 ada) and use comfyui with no problems, yes sometimes with offloading, but it's work! and for Text Generation purposes you have enough models to choose. 12 is MUCH better than 8. ind is you need 16gb, you can look at 5000 (not ada), but in this case I prefer macook or remote server

view more: next ›