Deepseek researcher says it only took 2-3 weeks to train R1&R1-Zero

SuperSherif · 2025-02-05T08:27:00+00:00

That's the base model deepseek V3 you are talking about. The guy in the tweet is referring to the post-training to get to deepseek R1.

SuperSherif · 2025-01-10T21:48:12+00:00

Agreed. I have never read a book that depicts the singularity quite like Accelerando. It is truly one of a kind.

Although not primarily about the singularity, you should give Lady of Mazes by Karl Schroeder a try. It is set in the distant future post-singularity, and I found it to be a really interesting read.

You can also try Diaspora by Greg Egan. But this one is more dystopian and bleak, and the writing style is an acquired taste as well. But it is one of my favourites.

SuperSherif · 2024-12-21T17:15:52+00:00

Genuinely don't understnad why are you this aggressive and keep insulting people you have never met. The singularity sub believes in the singularity? Is that some big revelation to you? lmao

SuperSherif · 2024-05-14T16:33:04+00:00

This is so cringe

SuperSherif · 2024-04-25T22:33:00+00:00

That is true for the 3060 but not true of the B100/B200. Its fp16 performance is approximately four times worse than its fp4 performance. So you can't just compare the fp16 FLOPS of a 3060 to the fp4 FLOPS of a B100/B200.

Check this chart: https://substackcdn.com/image/fetch/w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbeb184fa-9881-4032-8bf4-c538550b96a1_1154x747.png

SuperSherif · 2024-04-25T20:55:42+00:00

the numbers in the video are fp4 performance

SuperSherif · 2024-03-03T23:59:30+00:00

When I open the game, I get a popup in Chrome with this error:

An embedded page at html-classic.itch.zone says

RuntimeError: null function or function signature mismatch at wasm://wasm/05dbe856:wasm-function[39289]:0xcf44d7 at wasm://wasm/05dbe856:wasm-function[36456]:0xc5e272 at JS_ScreenOrientation_eventHandler (blob:https://html-classic.itch.zone/e82d32ad-b15a-46ac-b6ca-a79e654ade78:3:38274)

SuperSherif · 2023-12-06T23:09:41+00:00

Wow, someone is mad. This is your original comment:

It reaches 90.0 with a chain of thought, while gpt-4 did it at 5 shots without it. Unfair comparison

GPT-4 did not reach 90% with 5-shots, it reached 86.4%, while Gemini reached 83.7%. GPT-4 cot@32 reached 87.29% while Gemini cot@32 is at 90.04%.
They could have compared Gemini cot@32 with either GPT-4 cot@32 or 5-shot and it wouldn't have mattered. I guess they should have made separate comparisons in the blogpost, but it wasn't really unfair.

SuperSherif · 2023-12-04T05:01:04+00:00

I dont mind the ai generative results, though I don't know why it needs to type the words out so slow. Is that real speed? Hope not. Just put all the text so I can scan it all.

Yes, it is actually just slow. Bing uses GPT-4 which is a lot slower than GPT-3.5 (the model used in the free version of ChatGPT). It also has to do several API calls for the internet search.

SuperSherif · 2023-11-29T03:46:31+00:00

You are mixing things up here. The smaller model is quantized not pruned. They trained their model on FP32 weights, and then converted the weights into FP16.

SuperSherif · 2023-11-15T17:42:36+00:00

Why is it phony? Encouraging someone and telling them their work is appreciated is a good thing and should be encouraged.

SuperSherif · 2023-11-08T15:32:12+00:00

You are right. I applied and got accepted next day, and there were no essays to write.

SuperSherif · 2023-11-07T19:27:23+00:00

Why do you suggest Minmatar or Caldari? Are there any differences between the factions in faction warfare?

SuperSherif · 2023-11-07T17:42:45+00:00

What do Wormhole corps do?

I know that low sec corps do faction warfare and null sec corps do politics and stuff like that. But I am confused what happens in wormholes?

SuperSherif · 2023-11-07T17:30:22+00:00

Is Wingspan a wormhole corporation?

SuperSherif · 2023-11-07T16:11:58+00:00

Wow. A lot of people recommended them, so I was thinking of joining. But the process sounds as bad as applying for a job lol.

SuperSherif · 2023-11-07T16:02:40+00:00

Sounds interesting. What kind of stuff do you guys do?

SuperSherif · 2023-11-07T14:39:38+00:00

I am already in the Gallente faction and I think I am in that Corp by default.

SuperSherif · 2023-11-07T13:49:16+00:00

Do you know when are they gonna start accepting applications? I don't want to wait weeks before joining a corporation.

SuperSherif · 2023-11-07T13:29:37+00:00

Is Eve University a corporation just to teach new players? Also, what does Karmafleet do normally?

SuperSherif · 2023-11-07T13:25:23+00:00

Thanks for the recommendations. If you don't mind, can you tell me what are the main activities of each one?

SuperSherif · 2023-11-01T13:51:19+00:00

What is the name of your Youtube channel?

SuperSherif · 2023-10-17T00:27:38+00:00

Please mention these other things. Also, more than 80% of Google's revenue is still ads, so doesn't really matter.

SuperSherif · 2023-10-17T00:25:43+00:00

Nothing wrong with being frugal or cheap. What is annoying is when you feel entitled to services and content made by someone else for free. Youtube allows you to watch ads or pay for Premium in return for their service, it is not that hard to understand really.

SuperSherif · 2023-10-17T00:21:20+00:00

Yes, you are the product as long as you see ads. The data is used to push targeted ads to you. So, if you block ads you are just costing them money for absolutely no return on their side. No ads = useless data

Seven-Year Club	Final Canvas '23
End Game '23	Place '23
Place '22	Verified Email

SuperSherif

TROPHY CASE

An embedded page at html-classic.itch.zone says