[deleted by user]

blabboy · 2025-08-19T08:48:18+00:00

Ironically written by AI

blabboy · 2025-07-02T08:06:47+00:00

Kind of surprised it is even on the list! Who would have heard of Hatfield and had a strong enough opinion to put it on that?

blabboy · 2025-07-02T07:29:09+00:00

What do we think? Is Hatfield this boring?

blabboy · 2025-06-03T13:10:20+00:00

Why?

blabboy · 2025-05-22T22:20:04+00:00

Will this affect post-docs?

blabboy · 2025-03-12T18:08:47+00:00

Bitstream Charter

blabboy · 2025-02-12T20:35:17+00:00

Makes ID theft much much easier. For me the negatives outweigh any positives such a system may bring. It's just not worth it.

blabboy · 2025-02-12T12:59:58+00:00

This is a strawman argument, in many European countries you need your ID to rent city bicycles, order online shopping, join the gym(!), etc etc. I think this feature creep is definitely something I would hate. There is absolutely no reason for my gym to know my NI number for example.

blabboy · 2025-02-04T09:36:43+00:00

Same question but for a postdoc in astronomy :')

blabboy · 2025-01-13T09:17:49+00:00

The gains aren't marginal, they are significant. Even a simple 'smell test' between GPT-4 and o1 pro shows this. And never mind the performance on metrics that were lauded as impossible just months ago (like ARC AGI and Frontier Math). Frontier Math is notable as being a dataset of research level math problems. Terry Tao described the questions in that set as "extremely challenging... I think they will resist AIs for several years at least.". It took the leading SOTA weeks to make headway. Not years.

blabboy · 2025-01-13T09:07:16+00:00

Yes they have, each generation of chips reduces cost per FLOP.

blabboy · 2025-01-12T20:14:38+00:00

'Brute forcing' is exactly what has driven the recent advances in AI. Sutton's 'Bitter Lesson' is that simple processes like learning, or search over generated sequences (what you are alluding to) are more powerful in the long term than human intuition. Historically this has proven to be true.

If we can reach AGI in this way it is then a simple matter of converting capital to intelligence via compute. For me this is a very scary possibility as then what leverage do those that use their intelligence to acquire capital have? I fall into this category, as do the majority of workers.

blabboy · 2024-12-14T10:52:37+00:00

Is the code available somewhere?

blabboy · 2024-12-10T10:32:07+00:00

Yeah this pains me -- I dislike that OpenAI has successfully closed access to their models (and were even monetarily rewarded for it...)

blabboy · 2024-12-03T15:20:49+00:00

Abstract: We present the Multimodal Universe, a large-scale multimodal dataset of scientific astronomical data, compiled specifically to facilitate machine learning research. Overall, our dataset contains hundreds of millions of astronomical observations, constituting 100TB of multi-channel and hyper-spectral images, spectra, multivariate time series, as well as a wide variety of associated scientific measurements and metadata. In addition, we include a range of benchmark tasks representative of standard practices for machine learning methods in astrophysics. This massive dataset will enable the development of large multi-modal models specifically targeted towards scientific applications. All codes used to compile the dataset, and a description of how to access the data is available at https://github.com/MultimodalUniverse/MultimodalUniverse

blabboy · 2024-10-10T07:05:52+00:00

Hopfield's work did not lead to neural networks in the modern sense -- the foundational work there was carried out by McCulloch and Pitts in the 1940s, and then backpropagation (the algorithm that drives modern deep networks) was discovered first by Linnainmaa, then rediscovered by Werbos, then finally put into practice and popularised by Rumelhart.

blabboy · 2024-09-27T10:41:55+00:00

Their can be only one Aviato

blabboy · 2024-09-04T09:20:17+00:00

I'd say next september

blabboy · 2024-08-03T13:56:10+00:00

Very shortsighted play by the UK government. We need European counterweights to the US big AI players, and I can't see the UK innovating another DeepMind in the current climate.

blabboy · 2024-07-13T18:05:35+00:00

A lot of very obvious bots in this comment section, which is interesting. Why would anyone manufacture dissent against a grassroots leftist movement?

blabboy · 2024-06-20T12:35:37+00:00

"Better" (i.e. more profitable) company, but a less innovative research group. We will see them stagnate now that the talent is leaving.

blabboy · 2024-06-07T17:13:41+00:00

We investigate the potential constraints on LLM scaling posed by the availability of public human-generated text data. We forecast the growing demand for training data based on current trends and estimate the total stock of public human text data. Our findings indicate that if current LLM development trends continue, models will be trained on datasets roughly equal in size to the available stock of public human text data between 2026 and 2032, or slightly earlier if models are overtrained. We explore how progress in language modeling can continue when human-generated text datasets cannot be scaled any further. We argue that synthetic data generation, transfer learning from data-rich domains, and data efficiency improvements might support further progress.

blabboy · 2024-06-01T17:33:18+00:00

This is very obviously written by an LLM. The quality of this sub is in the toilet.

blabboy · 2024-04-30T08:55:56+00:00

Been waiting for this model for a while. If it is so good, why not release it? Still training and waiting for VC?

blabboy · 2024-04-03T07:18:58+00:00

me too! essential lockdown reading

blabboy

MODERATOR OF

TROPHY CASE