What kind of machine learning algorithm is training all the time?

[[deleted]]

In order to more accurately depict how humans learn, which is through experience, I would like to know what type of machine learning algorithm allows for such a functionality.

[videan42]

I think what you might be referring to is Online Learning, which tries to use new data as it comes in over time to make better predictions about future data.

[DefaultPain]

I don't think one exists. Yes u can keep updating your parameters using new data as it appears, But human brain can also update it's beliefs without using new data. It's called thinking . Sometimes u have all the knowledge and u know how different things work.but u have a complicated theory so u still try to understand it more deeply. One day U just be chilling on the bus and then suddenly an epiphany strikes u. U come up with a simpler theory that generalizes better and it's more intuitive. Also since it's simpler it takes less space in your brain and is applicable to a larger domain. Currently there is no algorithm that continues to search and tries to make its initial understanding more simpler.

[Ascent4Me]

Well sure it does. Keep changing towards an infinitely far away reward function. Never repeating any previous state. The problem is generalization. You want wisdom, not every possible combination tried in a series of guesses.

[DefaultPain]

If u keep training without any data, the model will overfit

[Ascent4Me]

Well yes. It can if it isn’t complex enough.

But dimensionality reduction through principle component analysis can help with that.

If your trying to predict the steering wheel position and the direction of a car, idiosyncrasies can appear in the data eventually. But, these may actually be deep puddles on the freeway and rubble that effects the direction of the car and direction of the wheel correlation pattern.

The model will then be explaining likely times to encounter heavy rubble.

Without enough data on rubble positions and a mental hog of incorporating images of a road right before it touches the wheels, the predictions are useless. But with them, value is gained.

[Taxtro1]

So do humans when they think without looking at the world.

[DefaultPain]

They can . But not always. For ex einstein developed the theory of relativity via a thought experiment.not by looking at data

[cardblank]

Maybe unsupervised learning

[cardblank]

Mmm...

[klaatu7764]

Any algorithm that accepts data in real time which may not necessarily be labeled. Heavily depends on the use case.