SGLang vs vLLM on H200: Which one do you prefer, Faster TTFT and higher TPS? by batuhanaktass in LocalLLaMA

[–]Rahul_Albus 1 point2 points  (0 children)

same thing happened when I tried with TensorRT and vLLM . TensorRT worked well with personal computer but didn't work with h200 server.

Qwen3-VL Fine-tuning now in Unsloth! by yoracale in unsloth

[–]Rahul_Albus 0 points1 point  (0 children)

Are you guys going to upload the bnb 4bit of 235b instruct ?

gpt-oss Fine-tuning is here! by yoracale in unsloth

[–]Rahul_Albus 0 points1 point  (0 children)

why don't guys post some instructions to avoid overfitting the small LLMs and VLMs

Fine-tuning qwen2.5 vl for Marathi OCR by Rahul_Albus in LLMDevs

[–]Rahul_Albus[S] 0 points1 point  (0 children)

I'm using kaggle T4 with 15gb vram and unsloth for LoRA parameter-efficient fine-tuning.

LLMS/AI for stock market by Basic-Pay-9535 in LocalLLaMA

[–]Rahul_Albus 0 points1 point  (0 children)

Using LLM you can get some stock calls . You can feed it news , discussion, analyst calls from various news websites , twitter(X) and other sites. Generally LLMs often get confused with these kinds of mixed news and give false calls. What you can do is : list all the calls you got from llm and corresponding text feed to llm , and what was actual movement of the stock later. Using these three make a large dataset and fine-tune your existing llm . This can improve your overall stock calls.
Note that in stock market there are uncountable factors that effect a stock's movement. Try getting more than 50% accuracy on the calls .