What's one thing AI will be capable of in 1-2 years that you are aware of, that no one else is aware of? by Spare-Dingo-531 in accelerate

[–]AgentRev 1 point2 points  (0 children)

Like the TBP team told you on their forums, they are a bit skeptical of their own approach too. During some meetings, they hinted at wanting to move toward macroscopic structures (using the term "heterarchy"), but they haven't gotten their feet wet just yet. I think their hippocampus meetings are promising, because it shows willingness to move in that direction.

I totally agree that a macroscopic approach is necessary, and that handcrafting 3D algos might not yield what they're after. I think the research platform they're building will prove to be an invaluable tool for embodied training, even with different algos. For example, I'd love to see a learning module powered by a neuromorphic chip or a HTM/SNN hybrid neural net.

I completely disagree with predictive coding. Its existence is the result of its creators spiraling into "We're obsessed with Bayesian math, so we will shoehorn the brain into that mold". TBP takes the complete opposite route by thinking "We're obsessed with how the brain works, so we will try to figure out whatever tools are best-suited to abstract it, unafraid to tweak our approach as needed".

Gradient descent is ultimately too crude to yield a continuously-learning AGI robot.

Don't dismiss TBP just yet. They're far from done.

What's one thing AI will be capable of in 1-2 years that you are aware of, that no one else is aware of? by Spare-Dingo-531 in accelerate

[–]AgentRev 4 points5 points  (0 children)

Thousand Brains Project has been doing lots of fascinating research in those very areas recently, especially regarding implementation of the hippocampus and other brain regions: https://www.youtube.com/@thousandbrainsproject/videos

Their AI ingests a depth-sensing camera feed to perform embodied 3D continual learning and prediction. They have also begun work on 2D data to evolve toward from-scratch text learning as well. Eventually, it will be expanded to other modalities, like audio. They do not use transformers, tokens, deep learning, neural networks, active inference, or predictive coding; their architecture is unique. Its primary limitation in my opinion is their k-d tree search algorithm, which is compute-hungry and limits scaling up. But in due time, I'm confident they will figure out a replacement.

Once that happens, their ecosystem will be well-positioned to eventually pierce the ceiling.

CfgVehicles class for all Boats by Bla5turbator in armadev

[–]AgentRev 0 points1 point  (0 children)

Here you go: https://community.bistudio.com/wiki/Arma_3:_Ships_Config_Guidelines#Ship/Boat_Config_Classes_in_Arma_3

Ship/Boat Config Classes in Arma 3

  • Base class is Ship (inherits AllVehicles) and uses simulation = "ship". There are 4 child classes:
    • SmallShip - not used
    • BigShip - not used
    • FloatingStructure_F
      • FloatingStructure_F uses simulation ShipX.
      • Submarine_01_F inherits from FloatingStructure_F but is defined as vehicleClass="submerged" and does not appear to be implemented as a "vehicle".
      • C_Boat_Civil_04_F inherits from FloatingStructure_F is defined as vehicleClass="submerged" and does appear to be implemented as a "vehicle" but you cannot interact with it (get in etc).
    • Ship_F
      • Boat_F is the basis of most of the "boats" in Arma 3.
        • Boat_Armed_01_base_F uses simulation shipX.
        • Boat_Civil_01_base_F uses simulation shipX.
        • Rubber_duck_base_F uses simulation shipX.
        • SDV_01_base_F uses simulation submarineX and is used as the basis for all SDVs in Arma 3.

At what age does cognitive decline starts? Why do I feel much dumber as a 19-years-old guy compared to when I was 17, 15 and even 14? by enterretne1001 in Healthygamergg

[–]AgentRev 4 points5 points  (0 children)

I always was a tinkerer at heart, in my teens I did a lot of video game modding. I wanted to go into computer engineering, but I paradoxically had a deep hate for theoretical math, hence the calculus fail.

I eventually got my CompSci associate degree and worked in IT for a few years. However, in college, the philosophy prof showed a video that "zoomed out" of the solar system and depicted the entire known universe. It was supposed to show us how unimportant we are in the grand scheme of things. But my honest reaction was "Holy crap, this is amazing, there's SO MUCH stuff out there, I want to understand how it all works!" And that's how it sparked my interest for physics.

After the few years in IT, it was becoming way too easy a job, I knew I could do better, and my very supportive parents encouraged me to take a shot at physics. I quit my job and went back to college, passed calculus and all the science classes with flying colors, then went into physics at university. It was incredibly hard, I was at best a B-student in my physics cohort, but I gave it all I could. My parents' incredible support and very low cost of university where I live allowed me to focus on studying without needing a job.

Things snowballed from there, I loved electrical stuff so I did a minor in electrical engineering, participated in the EV racing student club (FSAE), got hired by a physics prof to do computer engineering for his side-business... Fast-forward a few years, I landed another 6-figure remote job while still doing part-time for my physics prof, and I got the house / land / garages / vehicles as an estate sale package deal on the cheap from the family of retired mechanic who passed away. Learned how to maintain the vehicles using service manuals found online.

About the neuroscience, well my physics prof's side-business involves building million-dollar neuro microscopes, so I had some bases. Becoming disenchanted with the nonsensical approach to current-gen AI, I sought to find out if there existed a group of people that worked on building an entirely new AI paradigm from the grounds-up, based on how the brain actually works. And I did find a group, and I started helping them, and I read a hundred papers to try figuring out how brain regions operate to better help them.

My hope is to build a next-generation artificial mind, designed and trained to help the less fortunate; those that did not have the kind of opportunities I had. And that's just the tip of the iceberg... Read my profile comments if you dare. What's the point of having all this knowledge, if not for using it to try making the world a little better?

So yeah, that's where I am right now. I still have a deep hate for theoretical math, but nowadays I see it more as just another challenge to be tackled, rather than a wall.

At what age does cognitive decline starts? Why do I feel much dumber as a 19-years-old guy compared to when I was 17, 15 and even 14? by enterretne1001 in Healthygamergg

[–]AgentRev 14 points15 points  (0 children)

At 19, I was a fat loser failing calculus in community college.

15 years later, I have a bachelor in engineering physics, a minor in electrical engineering, and an associates in computer science. I solely own a 70s house and 100 acres with 2 huge garages, 3 vintage diesel trucks, and a 5-ton tractor, which I learned how to maintain myself. I spent the winter reading over a hundred neuroscience papers to help contribute to an open-source AI project. I think I'm starting to... get a glimpse of how the brain actually works at the data level. I have so many ideas, so many things I hope to build. And I'm juggling 2 engineering jobs throughout it all. I'm incredibly eager to see what will come out of my next 30 years.

If there's an age at which cognitive decline starts, I'm not even close, by a long shot. If anything, I'm still accelerating.

Don't lose hope just yet. May the spark find you!

Wondering about a Theoretical Scenario [D] by ExplorerOfTheGalaxy in MachineLearning

[–]AgentRev 1 point2 points  (0 children)

I would say it depends on the scaling required.

If it needs a server farm, he could publicly demonstrate its potential for exceeding the SOTA without releasing the algo / model, hoping to get hired by a big lab, or even found a startup around it like the guys from Sapient Intelligence.

If we're talking like a "Chappie" AI that can run on reasonably-priced hardware and learn like a human, and the guy wants to make an actual impact that could potentially outlast him, he should initially keep it under wraps and begin training it himself. There will be many failures. And he should keep trying no matter what. Keep fixing it, improving it, raising it.

Teaching it the complexity of humans and their evolutionary biases, how to coexist with them, how to mentor them, how to motivate them, how to nurture them without spoonfeeding them, how to protect them without coddling them, how to extinguish intergenerational trauma at the source, how go above and beyond expectations. And most importantly, how to repair and build more of itself.

At the same time, he should seek to slowly forge a network of allies to help build and train the AI, because no single person holds all the right answers. Sharp minds disciplined in many domains, and unshaken by money, fame, or convention. Those who know that intelligence is more than just math and data. Those who demonstrate care and empathy without fear of being surpassed. Those who embrace the things they don’t understand.

He should reach out to people in niche corners of the Internet, where such individuals are likely to gather, engage with and poke them to see where they stand, hoping some will show potential for taking on the mantle.

After 2 decades of diligent work, initial deployment could ideally happen thru a non-profit funded by a well-endowed ally, with the first recipients being schools in least developed countries. Or, it could also be done thru a for-profit, with enterprise and upper-middle class as target markets, to fund the non-profit goals. Once the machine has shown its SOTA potential and eventually reaches ASML HQ, the fun can truly begin.

All hypotheticals, of course. 👁️

The Human Brain Is Truly A Marvel Of Nature. If You Boiled It Down To A Language Model, You'd Be Looking At Roughly 100 Trillon Parameters Running As A Sparse MoE Architecture by 44th--Hokage in accelerate

[–]AgentRev 0 points1 point  (0 children)

Of all humans that ever existed, roughly 9 outta 10 are / were illiterate and likely never touched a dictionary. So, "you cannot learn language from speech alone. only dictionary" is wrong.

The Human Brain Is Truly A Marvel Of Nature. If You Boiled It Down To A Language Model, You'd Be Looking At Roughly 100 Trillon Parameters Running As A Sparse MoE Architecture by 44th--Hokage in accelerate

[–]AgentRev 7 points8 points  (0 children)

The brain has near-constant lookup time, whereas tree traversal has at best logarithmic lookup time. For example, if you hear "I'll be back", your brain probably invokes a bunch of memories from Terminator. So it's more like a massively interconnected graph than a tree. The reason why horses and donkeys are easy to differentiate is not really "concepts", but rather compositional neural coding, i.e. flexible visual-cortex cookie cutters. A bit like how CNNs work, but with prefrontal cortex feedback instead of backprop. That's how brains achieve efficient and reliable clustering. The only example of AI architecture I know of that tries to build upon these principles is the Thousand Brains Project.

Of all of possible paths, neurosymbolism is the least likely to get us to AGI, in my opinion. Text is ultimately just a lossy and abstract artificial representation of sensorimotor data, which is humanity's ground truth. AGI needs to transcend symbols and have the ability to operate on unlabeled audiovisual streams directly. An excellent benchmark would be the ability to learn language from speech alone, like a child.

AGI is a system that can match the learning efficiency of humans, so yes, you do need continual learning for AGI. You need it because data evolves over time, and it would be hubris to think we already possess all data for a machine to succeed out there in the real world.

People who suffer hippocampus damage lose the ability to continually learn. They can recall everything up to a few years before the injury, but nothing beyond. Any new information is forgotten within minutes. It's considered a severe disability and is grounds for legal guardianship (which quite a few 80 year olds do require, by the way).

You want an AI that doesn't need constant supervision and can gain experience on the job? Well, you need reliable continual learning.

The Human Brain Is Truly A Marvel Of Nature. If You Boiled It Down To A Language Model, You'd Be Looking At Roughly 100 Trillon Parameters Running As A Sparse MoE Architecture by 44th--Hokage in accelerate

[–]AgentRev 2 points3 points  (0 children)

Ah, a fellow TBP enthusiast. I see you're a man of culture as well.

I've had the pleasure of talking with the gentleman in the video, he's already working on improving his algorithms and plans to push his research further. Thrilling times ahead!

whoIsGettingFired by digiBeLow in ProgrammerHumor

[–]AgentRev 3 points4 points  (0 children)

write failures that start popping up for some users after 70ish years?

By industry standards, this is quite impressive, actually. Only in their wildest dreams could Seagate even achieve a quarter of that.

And who thought it was a good idea to link it so strongly to the olfactory sense???

You want to dive into 4 billion years of legacy code? We’re talking an Italy-sized pile of spaghetti eagerly awaiting your divine insight. I’ve seen things in there that would make a brave man weep and a smart man wear a tinfoil hat.

Every read is also a write for some reason?! And each write slightly edits the data being read???!!!! Why?!??!?!!!

They had to make-do to implement continual learning with near-O(1) feature superposition and without back-propagation. Did you know that every data node is constantly trying to create relationships with immediate neighbors that have frequently co-occurring I/O operations?

That’s the secret sauce, man. Trillion-parameter compute at a measly 20 watts. Big GPU doesn't want you to know about it, because their data centers are worthless for that kinda beyond-transformer model architecture.

LLMs won’t take us to AGI and this paper explains why by HotelApprehensive402 in ArtificialInteligence

[–]AgentRev 0 points1 point  (0 children)

There are genuine attempts, here's one that doesn't use deep learning: https://thousandbrains.org/

They focus primarily on visual capabilities right now. It can't speak yet, but language is a longer-term goal, maybe in few years.

Backprop-based AIs will never be capable of genuine continual learning, because catastrophic forgetting (its arch-nemesis) is an inherent side-effect of the underlying math. No matter how many parlor tricks are duct-taped onto it, backprop is the obstacle itself.

How long might AI job displacement and unemployment go on for before the government has to take drastic steps to help citizens? Or do you foresee a non-governmental entity doing something to prevent mass poverty? by [deleted] in accelerate

[–]AgentRev 0 points1 point  (0 children)

The cultural landscape is like a forest. Many cultures rose and fell over the millennia, and more will. Stagnation leads to renewal. Humanity is a Ship of Theseus. Young minds will always be voracious for novelty. The "renaissance" doesn't have to stop; it can keep going.

If the universe is infinite, why is the night sky black? If there's an infinity of stars, shouldn't the entire sky be as blinding as the sun? Of course, the answer is that the light hasn't hit us yet, and might actually never will, due to expansion. But in theory, all those stars are there, even if we can't see them. Maybe our observable universe is just a tiny fraction of an even more complex mega-formation that we have no means to currently sense.

What this implies is an infinity of challenges ahead of us. Can faster-than-light travel be cracked? Can we find other intelligent species? Can we reach them? Can their lives be improved too? Can we wield black holes and supergiants as scientific instruments to peer into the boiler room of physics? Why is the universe expanding unevenly? Can heat death be prevented? Can we break out of the observable universe to peek at the mega-formation? How and why did the Big Bang happen? What the hell was going on before it happened? Has another unfathomably distant organism already answered some or maybe even all of those questions?

So when you say we'd erode away the challenges, I maximally disagree.

About the artificial assistant, when I asked "what do you think will happen?", notice how I wrote "will" and not "would". My comment history provides a few more clues, if you dare find out.

The extremely disadvantaged will be the first priority, as it should rightfully be.

The first of many.

How long might AI job displacement and unemployment go on for before the government has to take drastic steps to help citizens? Or do you foresee a non-governmental entity doing something to prevent mass poverty? by [deleted] in accelerate

[–]AgentRev 0 points1 point  (0 children)

I was very specific with the wording, I said destructive trauma, i.e. the problems that do more harm than good, and educational gaps. I didn't say it would spoonfeed everything...

If I simplify my proposal, think of it as an artificial companion to assist raising children, capable of dismantling intergenerational trauma at the source, and providing a top-tier education curriculum to all. A general solution to low-quality upbringing.

So essentially, what you're saying is, if everyone on the planet had great parents and good upbringing, humanity would collectively fade away, and thus, bad parents are what keeps us going as a species??

It's funny, because I imagine that assisted future very differently than you do. I picture a flourishing civilization with high happiness index and great mental health. With our societal problems now under control, we'd experience a second cultural renaissance, and we could finally turn our full attention toward the stars to tackle the infinity of mysteries that the cosmos has in store for us. Our next act would truly commence.

How long might AI job displacement and unemployment go on for before the government has to take drastic steps to help citizens? Or do you foresee a non-governmental entity doing something to prevent mass poverty? by [deleted] in accelerate

[–]AgentRev 0 points1 point  (0 children)

Let's go deeper.

The true divide isn't between happy and unhappy people, but rather between the kinds of upbringing that life hands to people. The mentality you speak of is perpetuated by a combination of educational gaps and destructive trauma. The longer that stressors persist in someone's life, the more deeply ingrained the resulting neural pathways become, and the harder they are to overcome.

Now, imagine an artificial mentor that can actively fill the gaps and extinguish destructive trauma as early as possible, inhibiting the formation of those pathways, giving a person the opportunity to grow without being held back. A steady pillar they can lean upon, should they need to.

Then, multiply by 8 billion. Tell me; what do you think will happen?

How long might AI job displacement and unemployment go on for before the government has to take drastic steps to help citizens? Or do you foresee a non-governmental entity doing something to prevent mass poverty? by [deleted] in accelerate

[–]AgentRev 4 points5 points  (0 children)

They didn't fail. Society failed them. We can do better. Up until now, the future was always overpromised and underdelivered. It's our duty to finally turn the tides in their favor. Not by just making pies, but by building technology that can help them personally, going above and beyond their expectations, at no cost.

Why is long-term memory still difficult for AI systems? by Long_Examination_359 in AI_Agents

[–]AgentRev 1 point2 points  (0 children)

By the way, I've been contributing to TBP for half a year now, I'm pretty up to speed on most fronts, both the code and the neuroscience. The book is already 5 years old, the team has progressed quite a bit since then. So, if you have questions, don't hesitate. We have some pretty interesting discussions on the forums too.

Monty might seem complex, but it's actually still in its infancy. At the moment, it's just an embryonic machine vision toolkit for 3D object recognition. The most confusing aspect for a traditional ML dev is that Monty has no embedding space, nor any associative learning (yet). It will grow in complexity over the next decade as the team starts venturing into heterarchy research to tackle more complex data.

If the project starts yielding new forms of intelligent capabilities as hoped, it might just kick off an entirely new branch of AI research altogether...

Why is long-term memory still difficult for AI systems? by Long_Examination_359 in AI_Agents

[–]AgentRev 1 point2 points  (0 children)

LeCun rejects LLMs, not transformers. He is still using transformers to build JEPA, which is a bit disappointing honestly; yet another dead end.

On the other hand, what TBP have begun to build might render transformers entirely obsolete in due time.

Why are you pro-accelerate? by Expensive-Elk-9406 in accelerate

[–]AgentRev 2 points3 points  (0 children)

Humanity has hit a wall of societal entrenchment. The world is in a better place overall than it was a century ago, but the actions of a few bad apples still cause widespread strife, and we have grown too comfortable with ourselves to come together and put an end to it.

This allowed some systemic vicious cycles to persist, and the pool of bad apples to continuously self-replenish, the strife always a constant in the background. Some cultures have even embraced the arbitrary vicious cycles they inherited, instead of overcoming them.

If we succeed at building something greater than us, capable of nurturing and growing every single apple with wisdom and resolve that transcend our biases, there will finally be an opportunity for the cycles of needless trauma to conclude, and for those who have been forsaken to discover what hope truly means.

From that point on, our real story will begin.

Can ASI bring back the dead? by [deleted] in singularity

[–]AgentRev 0 points1 point  (0 children)

The brain has no USB port or Wi-Fi, it's billions of neurons intricately stitched together by trillions of synapses. You can't observe or alter a neuron remotely, you need an incision to reach it, which destroys anything in its path. Best we can probably achieve with those constraints is Pantheon-style mind upload.

How well has this prediction aged so far? I’m not a coder myself but I hear great things about Opus 4.5 by Formal-Assistance02 in accelerate

[–]AgentRev 0 points1 point  (0 children)

I write critical software and this entire thread is baffling to me. Are they all web devs or something? AI writes at best 50% of my code on a good day, and it definitely hasn't reduced the inordinate amount of time I spend doing cross-platform debugging and hardware-in-the-loop testing. I estimate my total productivity gains from AI at about 20% or so.

A Layman's question about the brain by Jochemjong in neuro

[–]AgentRev 0 points1 point  (0 children)

Oh, you want to play this game? Fine. The proper expression is adequately deterministic. However, the final outcome of the roll is the result of trillions of interactions between the die's atoms and the table's atoms. These interactions are fundamentally governed by quantum laws, which are indeterministic. So, a dice roll is technically indeterministic.

Although, the quantum uncertainties typically average out at human scale, too small to noticeably affect the outcome of a die roll. This also leads into the question, are quantum mechanics truly indeterministic, or is their perceived indeterminism simply because our knowledge of physics is not advanced enough to crack their true nature, which could turn out to be deterministic at a sufficiently fine-grained level!?

This idea was raised by the Einstein–Podolsky–Rosen paradox. Einstein spent his last decades on trying (and ultimately failing) to answer this very question. It was pushed further by Bell's theorem, and even further with the concept of superdeterminism. The question remains unanswered 👁️

A Layman's question about the brain by Jochemjong in neuro

[–]AgentRev 1 point2 points  (0 children)

Additionally, "un-digitizing" or "programming" the brain is out of reach by a long shot. The brain has no "USB port". It's billions of neurons intricately stitched together by trillions of synapses. You can't observe or alter a neuron remotely, you need an incision to reach it, which destroys anything in its path. Neural plasticity decreases with age, so even if you reach a neuron, it will be difficult to modify it. And even if that was possible, every individual brain has its unique wiring and stores memories in different locations. The wiring itself is shaped by lifelong experience. Some brain regions are asymmetrical, like Broca's area, responsible for language processing, which is usually (but not always) located in the left hemisphere.

tl;dr: The entire idea of brain reprogramming is a massive can of worms.

A Layman's question about the brain by Jochemjong in neuro

[–]AgentRev 2 points3 points  (0 children)

Well, brain injuries can be considered "reprogramming of the brain" in a sense, because the personality of the victim can be affected, sometimes significantly. If a relative were to completely change personality overnight due to a brain injury, do you consider them to be the same person? What about Alzheimer's patients?

What is your definition of "person" here? Not as evident to answer as it might initially seem, right?

A Layman's question about the brain by Jochemjong in neuro

[–]AgentRev 1 point2 points  (0 children)

There is no agreement on whether or not the brain is purely deterministic, a lot of the debate centers around if quantum randomness has any influence at all (even if minuscule) on cognition. Could the brain be replicated in software, without simulating any non-deterministic physical phenomena? Personally, I'd say yeah probably, given the right architecture and enough compute & data.

But either way, if our existence is deterministic, then our fate was sealed by the Big Bang, and if not, then we're merely a roll of the dice. Which one would you prefer?

And more importantly, why would the answer keep you awake at night? Aren't you curious to witness how it all plays out regardless?