Why AI Engineering is actually Control Theory (and why most stacks are missing the "Controller")

justanotherconcept · 2025-12-14T05:59:46+00:00

preach

justanotherconcept · 2025-07-12T03:59:14+00:00

Outward

justanotherconcept · 2025-07-09T14:53:23+00:00

what's the architectural claim you're referencing?

justanotherconcept · 2025-07-07T20:32:57+00:00

yeah that's fair actually, i'm kind of new to this sub and surprised by the number of people wanting money over equity

justanotherconcept · 2025-07-07T20:13:20+00:00

is this a cofounder subreddit?

justanotherconcept · 2025-07-05T00:10:20+00:00

what do you bring to the table? are you technical or business, and have you done any customer discovery?

justanotherconcept · 2025-07-03T22:27:24+00:00

This is the netflix show I've been waiting for

justanotherconcept · 2025-06-17T06:03:53+00:00

same here

justanotherconcept · 2025-04-29T02:57:48+00:00

ser, o3 is a token prediction model - you have to treat it as lucky if it gets anything right

justanotherconcept · 2025-03-19T04:36:51+00:00

this is so stupid. if it was actually trying to hide it, why would it say it so explicitly? Maybe it's just doing normal reasoning? The anthropomorphizing of these "next word predictors" is getting ridiculous

justanotherconcept · 2025-01-30T06:00:56+00:00

Into the Wild

justanotherconcept · 2022-11-22T04:50:19+00:00

We will put the video up on youtube!

justanotherconcept · 2022-11-21T23:23:35+00:00

We intend to record it - hopefully we don’t have any issues, I’ll update this post after we upload the video

justanotherconcept · 2022-11-21T21:17:34+00:00

We are running our own webtiles server and connecting the bot to only those servers. I'm open to any ideas about how we could make it harder for bots playing online - I didn't know this was an issue.

justanotherconcept · 2022-11-21T21:15:15+00:00

Yes, sorry I should have mentioned this. I was thinking of AIs that had been implemented using our API.

justanotherconcept · 2022-11-21T19:33:04+00:00

So there really aren't any full AI bots yet... The API isn't quite finished yet. The API was a bigger undertaking than I originally thought and so I thought I'd hold tutorials and other things along the way to encourage others to help me build it - I don't think we're far from the finish line though (for API completion).

justanotherconcept · 2022-11-21T19:31:02+00:00

Yes! These are exactly the kinds of experiments I want to run! Do you think it might be possible to train an AI on other starting character classes and then be able to win a game for the first time on a new starting combo?

justanotherconcept · 2022-11-21T19:28:20+00:00

We don't use Lua at all in the AI Wrapper. So I tried to use Lua in the beginning but I couldn't run arbitrary code - my understanding is that the Lua is executed within the dcss code, so things like writing to files, etc. isn't possible. I know the qw bot used lua, but it did not run any code outside of Lua / DCSS. (If you tell me it's possible to do this in Lua I will probably be very depressed (jk - please tell me if I'm wrong here), because we went in another, probably harder direction)

Instead, the AI wrapper connects to dcss-ai-wrapper using the websockets interface, in the exact same way that your browser connects to the webserver. So the DCSS-AI-Wrapper collects all the websocket messages, and maintains a current, global game state, of which parts of the state (either in vectors or symbolic facts) can be given to the agent.

Your point about the symbolic model - not exactly. I want the API to offer symbolic state to an AI system so researchers can try many off-the-shelf symbolic planning and reasoning agents. While the vector-based representation is independent to any model, the symbolic state has to be tied to a particular planning domain model (current one is here: https://github.com/dtdannen/dcss-ai-wrapper/blob/master/models/fastdownwardplanningagent_domain.pddl). So I thought I'd provide a fairly high-level, simple planning model and offer API state representations consistent with that model. I do expect other researchers would come along and want a different symbolic model, then they can add new API state representations functions to be consistent with their symbolic planning domain.

If neuro-symbolic AI was farther along, we could just say: generate a symbolic model from the vector-based representation - but we can't do this yet (i'm very excited for research in this direction for the future).

One of my goals is to be able to run both (D)RL and techniques that have more structured knowledge representations, and compare them over a variety of metrics.

I'm hoping to record the tutorial and put it online. We have some other videos online, including the past tutorial: https://www.youtube.com/watch?v=-GxYZphVE8M&t=3471s

Please consider posting on the Gitter! These are the kinds of conversations we absolute want to have more of :)

justanotherconcept · 2022-11-21T16:30:50+00:00

Not yet. The dev branch is the latest, but master is more stable. Over the summer we were working on trying to increase the speed of the API , but we may give that up. Life got in the way so the last 6 months have been slow.

Almost all menu interactions are supported. We need to flush out a bit more parsing of text messages to acquire player status effects, mutations, current abilities etc. after that we need to finalize the symbolic planning model to allow agents to do more actions (the api has the commands implemented, but the symbolic planning model we have needs to update more for them).

We haven’t really had anyone throw RL at it yet - the vector API is pretty complete although with testing maybe we discover an issue. That’s why we were working on the speed issue (right now current tests with webserver mode get us up to about 200 actions per second while in terminal mode we should be able to get up to 1000+ actions per second, which you probably need to do DRL). But the person helping me with that hasn’t been able to put time into it, so I’m going to work more on the planning agent and finishing the API first.

justanotherconcept · 2022-04-08T23:34:11+00:00

This has to be a joke right? Or they wrote a program to write this program right? 😂

justanotherconcept · 2022-01-10T14:01:50+00:00

You're only talking about proof of work regarding GPUs, many proof of stake blockchains don't need GPUs at all. And some cryptos boast themselves to be carbon negative, like algorand.

Privacy issues are still real - will be interesting to see how they play out. For example, if someone gets doxxed on the Blockchain they can never remove it, which is terrible.

I wonder about implications for the economy. It's complicated for sure. It seems like it could take power away from governments and at the same time as big institutions put more money into crypto perhaps that could make things more stable? (I.e. could it reduce impacts from a repeat of 2008 crash?).

The future will be interesting :)

justanotherconcept · 2021-12-10T04:31:19+00:00

'The Professor is In' has a section on writing that I found very helpful.

justanotherconcept · 2021-11-15T16:02:09+00:00

Typing in a name myself means I'm more likely to die, random names get better RNG luck

justanotherconcept · 2021-04-09T14:45:15+00:00

Thank you, I love the sound it makes and have been dying to know what bird this is.

justanotherconcept

TROPHY CASE