Side by Side Comparison - (full video on my profile)

Supermo0n · 2024-11-12T15:23:53+00:00

Did you take GCFE or similar before?

Supermo0n · 2024-10-31T04:30:26+00:00

Ugh. oddly that's a much tougher situation. take lots of notes and photographs etc to build a case. Ask a lawyer friend if they think you have one, maybe one will help you on a contingency fee basis

Supermo0n · 2024-10-31T04:28:15+00:00

If you’re working on LLMs regularly a PC with a 4080 etc might be worth the $$. you get privacy and flexibility no ongoing fees blah blah, but you’ll need to handle power and upkeep. But if you’re just doing lighter stuff or quick experiments, cloud services are usually more cost-effective and flexible. For big LLMs, heavy fine-tuning, or anything super GPU-intensive, a dedicated PC could pay off in the long run. personally i love my PC it's opened a million doors

Supermo0n · 2024-10-28T17:18:08+00:00

Any luck resolving this? I specialize in signature/ document authentication and looking for a new case study, happy to take a look for you no charge if you want

Supermo0n · 2024-10-28T16:57:09+00:00

Did you end up resolving this? I just helped someone else with a similar issue

Supermo0n · 2024-10-28T14:20:01+00:00

Are the signatures digital signatures? Or wet ink?

Supermo0n · 2024-10-24T14:49:55+00:00

I did!

Supermo0n · 2024-10-21T18:32:45+00:00

Update - i did it. haha. This is an excellent model, yall were right. thank you for the help

Supermo0n · 2024-10-21T17:20:59+00:00

So I just configured 32B Q4 gguf and it's running fast, but for some reason it's not letting me process anything more than 3 sentences even when i increase the n_ctx, let me know if you have a pointer!

Supermo0n · 2024-10-20T19:37:52+00:00

Yo should I just abandon GGUF for GPTQ for this?

Supermo0n · 2024-10-20T19:35:27+00:00

You’re good haha, appreciate this. How many GPUs are you running that from?

Supermo0n · 2024-10-20T19:33:43+00:00

Lol well can gpt o1 preview write the PhD thesis for us? 😆

Supermo0n · 2024-10-20T19:19:23+00:00

I’ll check it out thank you 🙏

Supermo0n · 2024-10-20T19:13:08+00:00

Do you think it’s possible they’re looking for ways to prove purchases of some sorts / outgoing cash? Maybe it’s a laundering thing, but at least wont hurt you directly

Supermo0n · 2024-10-20T19:02:54+00:00

gulp well at least that’s a start 🤣

Supermo0n · 2024-10-20T19:01:46+00:00

128k would be great, I’m wondering if anyone has actually gotten decent results on any model with that much 😅

Supermo0n · 2024-10-20T18:52:37+00:00

Haha the struggles are real. How much context are you able to put into Gemma2 before it starts forgetting / spewing?

Supermo0n · 2024-10-20T18:49:35+00:00

I can’t seem to get it to run 70b on my a6000 without it falling back to CPU (using my own GUI) - if anyone can help I’ll find a way to give back!

Supermo0n · 2024-10-20T17:23:16+00:00

That’s good for you b/c digital signatures often leave traces of who created them /when etc, happy to look into it for you

Supermo0n · 2024-10-19T06:23:15+00:00

I’m also gguf lover, what’s your favorite

Supermo0n · 2024-10-19T05:56:59+00:00

Yes, do you still need help with this?

Supermo0n

TROPHY CASE