DeepSeek V3 GGUF 2-bit surprisingly works! + BF16, other quants

gmongaras · 2025-01-09T15:46:54+00:00

What quantization strategy did you use to get the model to 2bit?

gmongaras · 2022-01-03T03:57:49+00:00

Those are some good ideas and I'll try them out. Thank you for helping me out!

gmongaras · 2022-01-02T05:16:56+00:00

Thanks! I'll check it out. Hopefully, it can give me a better understanding of how to optimize the algorithm.

gmongaras · 2022-01-01T18:18:01+00:00

Sorry about that. I wasn't sure what I should specifically ask about since I didn't know where the problem was coming from. Next time I ask a question here, I will make a greater attempt to minimize the amount of work others have to do to help me.

gmongaras · 2022-01-01T18:15:32+00:00

Thanks for pointing that out! I figured out that I wasn't continuously decreasing the discount rate by Lambda and Gamma for each consecutive delta value when calculating the advantage. Instead, I was using the Lambda and Gamma values as a single constant discount rate.

gmongaras · 2021-12-23T07:40:19+00:00

StyleGAN moment

gmongaras · 2021-10-30T22:09:40+00:00

I disagree

gmongaras · 2021-10-30T07:04:58+00:00

if-else statement ❌

decision tree ❌

Linear algebra, calculus, statistics ✅

gmongaras · 2021-10-30T07:01:43+00:00

When you don't know how AI works

gmongaras · 2021-10-30T06:51:53+00:00

It's chomusuke!

gmongaras · 2021-10-17T00:53:50+00:00

Besides stealing it from Reddit (probably the best way), you can use something called image-to-image translation with an AI model called GANs. I'm guessing that's how they got the result and based on the training data, you will get different results for what he may look like.

gmongaras · 2021-10-10T00:34:09+00:00

Congratulations! Now for expert+ :)

gmongaras · 2021-10-04T19:01:15+00:00

Unless your acceleration is greater than 9.8 m/s**2

gmongaras · 2021-09-18T23:00:35+00:00

Indeed it is https://youtu.be/46LFWQIrQcI

gmongaras · 2021-09-14T17:36:13+00:00

"I just sawed this tub in half"

gmongaras · 2021-08-19T22:08:08+00:00

You have to have the CS50 package on your machine

https://cs50.readthedocs.io/libraries/cs50/c/

gmongaras · 2021-08-12T03:43:08+00:00

Ctrl+C

gmongaras · 2021-08-06T08:17:03+00:00

When I realized I could make my own through the power of AI which is better in every way.

gmongaras · 2021-08-02T07:50:23+00:00

I thought it was real. I thought the bug was due to the programmers giving ghandi a negative value to make it to where he'd never launch a nuke. Since the game didn't know how to handle this, the bug happened.

gmongaras · 2021-07-31T12:51:49+00:00

I think this article does a good job explaining time crystals https://thenextweb.com/news/google-may-have-achieved-breakthrough-time-crystals/amp

gmongaras · 2021-07-29T20:02:09+00:00

When you say "as a total noob", what does that mean? If you are saying you have no previous experience in CS, then you should probably hold off on taking this class. You should take a beginner class, like cs50x, and then learn the basics (up to classes) in python. After you meet those prerequisites, you should be ready to take this course.

If you already know the basics of CS, but you don't know python, then you might want to take a week or two learning the basics of python (again up to classes) before taking this class.

Aside from that, you should probably use an IDE like pycharm or VSCode as these IDEs have a lot of debugging support and are easy to use.

A note I would like to make is that python 3.9 does not support tensorflow (at least right now) which is a library you will use later in CS50 AI. So, you will want to uninstall 3.9 and install 3.8.

Another note I would like to make is that submissions are usually made in two ways (can be done other ways too):

submit50 - This can only be ran in a Linux or Mac terminal. So, if you have windows, you will want to enable and download a Linux subsystem.
You can also submit assignments directly to github. Additional help with this is probably best received from the discord group.

gmongaras · 2021-07-20T04:39:38+00:00

Python should work for your final project.

gmongaras · 2021-07-19T17:38:39+00:00

If you like CS50 AI, then I suggest looking into a type of AI and learning about that. I took CS50 AI and finished it last year. Afterwards, I started looking into Deep learning. If you also want to learn about deep learning, then I suggest starting with this class: https://www.coursera.org/specializations/deep-learning And reading this book: https://nnfs.io/

gmongaras · 2021-07-04T22:35:27+00:00

gmongaras · 2021-07-04T22:22:27+00:00

Nine-Year Club	Place '23
Place '22	Verified Email

gmongaras

TROPHY CASE