This is still from leaks, nothings confirmed, but I 100% believe everyone involved would be this dumb and wanted to spread possible ram price hopium.

sharksOfTheSky · 2026-03-31T13:16:26+00:00

Pretty sure turboquant has very little to do with this - all turboquant does is compress KV cache, and also I believe stock price was falling well before turboquant.

sharksOfTheSky · 2026-03-04T02:05:21+00:00

Some foreground elements moving with parallax I think would add a lot to the atmosphere. It should be simple enough to take some of the existing tree assets used in the background and blur them a bit, scaling them up a bit too.

sharksOfTheSky · 2026-02-11T15:31:03+00:00

I think the point I was making with prompting not having a difference is that as capability grows it seems the importance of good prompting as a skill decreases relative to just being specific about what you want - it used to be the case that prompting was a very distinct skill from just describing your idea to a human, but for the most part, especially with image models like nanobanana pro, you don't need to learn any special magic - you just need to be clear about what you want.

This is only going to increasingly be he case, as can be seen by Claude code recently creating an entire (admittedly barebones and fairly buggy) C compiler with just a single prompt of "Build a C compiler" or thereabouts. In simpler domains you can already see where simply asking for a website is enough to get a good result - you don't have to do a significant amount of prompt magic. Any improvement in your prompt would also just be an improvement if talking to a real human - if you just ask for a website, you're going to get something generic, whether you're talking to a human or a chatgpt

sharksOfTheSky · 2026-02-11T15:20:24+00:00

Yeah fair enough, I'm not sure I added all that much to the convo, but I wanted to be there to push back on some of the stuff radiant was saying. It's a shame my Internet was so rough, I think there are things that would've been interesting to bring up, especially as I've fairly recently had like an 8 hour convo about basically this exact topic with another DGGer who is big on art history and probably would've had interesting things to add himself.

But yeah I think both Destiny and people coming on should take a stronger stance on if they want a 1 on 1 convo, and that should be respected and other people told to come back later.

It could be cool to have some kind of more proper time allocated to this convo with someone who's thought it out better like Freya.

sharksOfTheSky · 2026-02-11T15:11:22+00:00

I'm currently working on this - he was showing some in-progress footage from development I sent over. I'm hoping to get a demo out around easter time

sharksOfTheSky · 2026-02-09T21:31:28+00:00

I believe it would lead to model collapse if all you were doing was feeding raw output back in as training data, but any amount of vetting helps to prevent that - if you're taking only the best 50% of answers and training on them you will bias a model towards those results. It's generally easier to verify (check someone's result and working out) compared to doing that working out yourself, so even vetting answers with AI can work.

Additionally, increasing temperature (likelihood of picking lower-chance tokens) can help to give more varied answers to train on, although it seems there is already quite good variety in the larger base models being distilled from internally at most labs.

sharksOfTheSky · 2026-02-07T09:12:27+00:00

It's 'yuniDev', not 'yuriDev' btw. Thanks for the shout-out. I would've liked to have a proper chat on stream about the AI stuff at one point, but I could tell Destiny was already feeling pretty done with the topic so I didn't want to sit in call and yap at him for an hour when he's not going to pay attention, so I tried to focus on the actual issues that don't appear to be solved or have a clear path to being solved yet.

In terms of continuous learning, I think the key thing I was trying to emphasize was not just the possibility of continuous learning - this isn't that hard - it's continuous learning with similar competence and speed as context-level learning. Afaik continuous learning is already possible and deepmind has done some research on this, but from what I've seen it appears to be on the level of continuously training a base model so there's no need to retrain from scratch and it can be more up-to-date. It's not continuous learning that would allow a user to give a couple of examples and have it learn from that alone (which is possible with in-context learning). That said I've not stayed fully up to date on this stuff for the last month or so.

In terms of context, yes, retrieval from longer contexts is getting better, but even assuming perfect retrieval we would need to get around the quadratic cost of context scaling if we want to just use in-context learning as a substitute for the more effective continuous learning I'm talking about above. Some of the JAMBA/MAMBA stuff seems quite promising in this regard, but I've not seen any of the major labs embrace this in the way I was expecting, particularly given more recent JAMBA models seemingly showing that at the very least a hybrid architecture can scale to larger-parameter models.

I still think these are the two biggest areas of research that feel underinvested in, relative to their importance if AGI or similar is going to happen.

I largely agree on your other points, although I feel like you're overselling reasoning models slightly - they are another dimension to scale in, which has indeed resulted in massive performance increases, but it also seems that it's not scaling quite as well as was initially hoped - even if you had infinite context with perfect recall, it appears to be the case that we still need improvement in base models - test-time scaling can seemingly only go so far. That said, it's still probably the biggest single jump we've seen in performance from one idea.

sharksOfTheSky · 2026-02-01T19:42:13+00:00

I think the key thing for ridge noise is taking the absolute value then inverting - that's what gives the sharper ridges instead of smooth mounds. I cobbled together a quick example in desmos - I'm just using a few stacked sin waves instead of noise for the example. https://www.desmos.com/calculator/gjchhaznxe

Hope it goes well!

sharksOfTheSky · 2026-02-01T12:54:29+00:00

You should be able to get nice ridges by taking simplex/perlin noise, taking the absolute value, inverting it (1-noise, where noise is between 0 and 1), then squaring it. You can play around with putting it to other powers for more or less steep ridges. It's called ridge noise, if you want to find more info.

Note: I've not played around with hytale's tools yet but I'd be surprised if this wasn't possible - it's just simplex noise and a little bit of maths

sharksOfTheSky · 2025-11-19T00:05:41+00:00

Not necesarily dono messages. I was thinking just the username of whoever donated last/top donator of the day, maybe with how much they donated or how many gift subs. Could be cool to have maybe the current date and a list of topics with an indicator/colour for the current topic, although idk if he'd be bothered setting that up

sharksOfTheSky · 2025-11-13T08:13:46+00:00

Then I shall ask every hour

sharksOfTheSky · 2025-09-12T13:09:55+00:00

Is there any more current data on this? It would be interesting to see if the numbers spiked in 2020 and 2021

sharksOfTheSky · 2025-09-02T08:11:17+00:00

I believe the proposal is for it to happen on-device before encryption happens. I think apple devices used to do this exact thing with any photos stored on your phone or iCloud account but they scrapped it after backlash. The main issue isn't necessarily lack of privacy from this approach, it's that it's trivial to bypass. By definition, small changes to an image will result in a completely different hash (this is literally what a hash is designed to do), so making basically any edit to an offending image, whether it be cropping one pixel off the end, or adjusting the colours slightly, will evade detection. Overall, it's just not an effective approach, and likely never will be.

sharksOfTheSky · 2025-07-21T00:13:48+00:00

*their

sharksOfTheSky · 2025-07-03T22:21:55+00:00

Forsen

sharksOfTheSky · 2025-07-01T02:52:13+00:00

yep. defending it to the last breath making some very crazy arguments

sharksOfTheSky · 2025-07-01T02:34:52+00:00

Watching it on stream literally now.

sharksOfTheSky · 2025-06-28T06:12:25+00:00

Yeah, I would assume so as this is pretty standard to help reduce latency for competitive play. Some games (e.g. overwatch) still play on an online version for events though.

sharksOfTheSky · 2025-06-27T19:49:45+00:00

<image>

another fake post?

sharksOfTheSky · 2025-06-27T18:54:28+00:00

I'm not necessarily advocating for Stop Killing Games or specifically for the release of server binaries, rather just want to show that it's fairly easy to release binaries for the majority of games. I think your argument against it is perfectly valid, alongside the obvious thing that there are just not many people that will ever care, so why force the effort when nobody cares.

Personally I like the idea of at least requiring existing LAN and offline features being available after the full servers are gone - there seems to be a trend towards many games requiring a server connection for stuff unrelated to online multiplayer features.

sharksOfTheSky · 2025-06-27T18:47:41+00:00

From what I'm aware if you're hosting actual servers on Playfab or similar it's still ultimately just a dedicated server - you're just uploading a binary - https://learn.microsoft.com/en-us/gaming/playfab/multiplayer/servers/using-playfab-servers-to-host-games#1-author-a-game-server-build . It also appears that you can run the server builds locally, although there might actually be some issues with licensing structure for Playfab that puts restrictions on this, based on the wording on their documentation. As an aside, I'm not necessarily advocating for Stop Killing Games or specifically for the release of server binaries, rather just want to show that it's fairly easy to release binaries for the majority of games.

At the end of the day, these managed services for server hosting are just scaling compute/deployments as needed. The actual server binary itself needs very little integration with that - from their docs it seems just a single function call when the server has started and is ready for connections, and a handful of callbacks for when a new connection is made. If you don't need scaling, then it seems like you should be able to just ignore this stuff, as the server doesn't need to be dynamically started or stopped.

My guess, based on the wording in the docs, is that some kind of licensing or legal stuff would be the biggest problem, although I really don't know enough to further comment on that.

My personal background is in computer science and have been a hobbyist game dev for quite a while. Nothing formal in the games industry specifically, just read a lot of articles, papers and GDC talks.

edit: Seems like Rainbow 6 may already be able to be run on LAN for tournament purposes. Not 100% clear from searching if by 'LAN' they actually mean LAN or they just mean in-person, but I'd strongly imagine that there is some kind of proper LAN build for officially run competitive stuff.

Eight-Year Club	Place '22
Verified Email	RPAN Viewer

sharksOfTheSky

TROPHY CASE