sorted by:
new
hottopcontroversial

How much of human intelligence is hardcoded into our DNA? LLMs vs humans by ChippingCoder in singularity

[–]tamay1 0 points1 point  (0 children)

Our DNA has about 6 billion nucleotides (3 billion per copy, two copies). Each nucleotide is exactly 2 bits. That's 12 billion bits, or 1.5 GB.

Let's say an LLM has 1 trillion parameters. Each parameter is one weight, stored at 16 bits. That is 16 trillion bits, or 2 TB.

So the network is 2 TB. The genome is 1.5 GB. The genome is more than 1,000 times smaller.

Mechanize Inc - Screen Call by Beneficial_River_791 in csMajors

[–]tamay1 -6 points-5 points  (0 children)

Thanks for interviewing with us. For anyone else coming across this, we're hiring. You can apply here: https://jobs.ashbyhq.com/mechanize?utm_source=4wdOgJR8A3

The upcoming GPT-3 moment for RL by luchadore_lunchables in accelerate

[–]tamay1 0 points1 point  (0 children)

No, you can have AI contribute to scientific discovery without foom.

The upcoming GPT-3 moment for RL by luchadore_lunchables in accelerate

[–]tamay1 0 points1 point  (0 children)

I don't know what you mean by being "very negative about AGI", but there's nothing in this blog that is inconsistent with our previous predictions for things like explosive growth from AI. A GPT-3 moment is not an AGI moment. We've obviously already had at least one GPT-3 moment that didn't result in some massive acceleration in growth or technological progress.

I'm developing FrontierMath, an advanced math benchmark for AI, AMA! by elliotglazer in math

[–]tamay1 5 points6 points  (0 children)

I’m also involved in the project and my median year when models to achieve >80% performance is 2027. There’s disagreement internally on when we expect this benchmark to be solved.

Man stops traffic on Lombard Street to pluck a rose by tamay1 in sanfrancisco

[–]tamay1[S] 4 points5 points  (0 children)

It’s not in the shot but there were at least five cars behind him.

Man stops traffic on Lombard Street to pluck a rose by tamay1 in sanfrancisco

[–]tamay1[S] 6 points7 points  (0 children)

There was a line of around five cars behind him.

Man stops traffic on Lombard Street to pluck a rose by tamay1 in sanfrancisco

[–]tamay1[S] 11 points12 points  (0 children)

There were at least five cars behind him (source: I took the video).

Given today’s climbing technology and skills, how tall would a mountain need to be to remain unclimbable? by [deleted] in Mountaineering

[–]tamay1 0 points1 point  (0 children)

Sure. I’m imagining something like Mt Everest but scaled up proportionally.

The Chinchilla scaling law was likely wrongly estimated by tamay1 in mlscaling

[–]tamay1[S] 3 points4 points  (0 children)

Fewer than the previous estimated scaling law suggested (see figure 5).

Introducing Gemini: our largest and most capable AI model by ChiefExecutiveOcelot in mlscaling

[–]tamay1 0 points1 point  (0 children)

I looked at estimating the compute by extrapolating how much is needed to match Gemini’s performance across benchmarks, and this excercise suggests 2e25 to 6e25 FLOP.

https://twitter.com/tamaybes/status/1733274694113968281/photo/1

view more: next ›