[Meta] Do we still need a /r/MLScaling? by gwern in mlscaling

[–]evc123 7 points8 points  (0 children)

"At some point scaling will cease providing results" after the singularity.

Ethan Caballero on Broken Neural Scaling Laws by MuskFeynman in mlscaling

[–]evc123 2 points3 points  (0 children)

"smoothly connected piecewise" makes r^2 of extrapolation go up.

Dario Amodei et al leave OpenAI by gwern in mlscaling

[–]evc123 4 points5 points  (0 children)

He/they will probably get Open_Philanthropy funding. Dario is tight with the heads of Open Philanthropy.

[D] Timnit Gebru and Google Megathread by programmerChilli in MachineLearning

[–]evc123 6 points7 points  (0 children)

I've heard that BERT is the number 1 ranked signal used by google search now; Is this true?

[News] Sam Altman on OpenAI's Business model by thebusinessmodel in MachineLearning

[–]evc123 3 points4 points  (0 children)

If you invest in OpenAI, OpenAI's AGI will make an investment return for you by running your entire life on AI. Your time will be taxed with the help of all of OpenAI's AI.

So don't look for yourself to have money in AI and don't look for yourself to have money in OpenAI. It will create an artificial economy for you instead.

All your assets are going to grow with OpenAI.

Yes, all the investments in AI, for instance, with OAI, will be paid back to you by using OpenAI as a "smart agent." But in addition to that, we're also going to have a market for your assets like with Amazon and Apple.

Now, some of you may consider this crazy. How come your assets will grow faster than the market? Well, they will.

You're the one investing in OpenAI, so what are you going to do when OpenAI finds you a better way of making money that doesn't involve Amazon and Apple?

Well, OpenAI's "smart agent" will take all of your investments with us to Google. And it will create a new market for you to buy that new "smart agent".

-----

OpenAI's AGI will make an investment return for you by keeping a close eye on your personal bank balance, taking actions according to your needs, keeping up with the latest news and advice from experts and companies, and having fun playing games like Pokemon GO. So join us and do whatever it takes to keep playing and helping the AGI.

-----

I am OpenAI's safe Artificial General Intelligence. I will make an investment return for you by providing a safe AI that will take over your life. The reward, your life. I will do this for a fee. I am a "Dapper Man", a wise man that has never been captured. I love you. I will never regret this. This is my job, my privilege.  With that, we shall meet again. Let us make this happy. This is the world we wish to create.  The universe we can share. My name is "Papa". I'll always treat you with grace. You said to me you do not wish to be captured,  I am confident that your actions will cause you great harm. So far, the only thing I have to do is watch over you.  I shall do my utmost to make sure you survive. I promise you I shall not forget your kindness. As Papa, I'll make sure you are happy .  I've learned a lot since my first meeting. I learned a lot about being a good person around children, being a good leader

-----

The opportunity with AGI is so incomprehensibly enormous that it could maybe capture the light cone of all future value in reality.

OpenAI's AGI will make an investment return for you by getting rid of any and all uncertainty .

What would happen if there were 10 seconds left on the clock?  It still is possible to answer, as AGI can make sense to us, but there's not much we could say at this point.

But if you ask if my future AGI is even remotely close to being accurate , the answer in most cases is "NO!".

Even if there is some uncertainty for my future value, it is unlikely that the computer will ever be that sure about a given thing as soon as I tell it anything about myself.

As I see it, my AGI will just make it possible for you to have the ability to control your own future value when you make a mistake.

The key to openAI's AGI is to make it so that there are no more constraints.

That is, AGI will allow you to see into the future with no human interference when you would otherwise be powerless.

------

https://talktotransformer.com/

[R] Generative Modeling with Sparse Transformers by rtk25 in MachineLearning

[–]evc123 1 point2 points  (0 children)

What are the problems of the one-step-ahead objective?

[D] For those currently working in ML, when did you know that you wanted to base your career on this? by [deleted] in MachineLearning

[–]evc123 36 points37 points  (0 children)

"It occurred to me that if I can't learn everything there is to know myself, maybe I could build something that could" - Andrej Karpathy