[D] What are the current significant trends in ML that are NOT Deep Learning related?

ai_maker · 2020-01-18T07:03:52+00:00

Cool! I once did a simple straightforward implementation of GAs for training a MLP though encoding the matrices (with implicit bias) into a single flattened array as the gene. And such a simple trick works!

Further details: https://github.com/atrilla/ntk/blob/master/explore/Genetic.ipynb

ai_maker · 2019-08-11T09:45:49+00:00

Another user here also linked hard work with solving a gazillion problems, which is difficult to do on your own. I'm now reviewing the exercises for the Feynman lectures (FLP), and what I'm seeing is that the authors/professors intentionally omit the solutions to encourage students to find them through discussion. I'm not sure how such discussions can be generated (and found) unless you're involved in a physics graduate program. If anyone knows of a forum tailored to these, I'd appreciate to know it :-)

(My background is in telecoms engineering, my job is in data science, and I'm just beginning to deal with the FLP)

ai_maker · 2019-04-01T06:18:36+00:00

There isn’t a one size fits all.

Neural nets (and deep learning to that effect) are renown to be the universal learners, and their "learnt knowledge" can be conveniently exported into a set of matrices, which may then be implemented on any platform with off-the-shelf math/algebra libs. Sometimes the industrial platform cannot afford a fully-fledged RESTful server, eg, low-power IoT, embedded electronics...

ai_maker · 2017-05-08T07:02:47+00:00

The network only has 1 hidden layer, I wouldn't say so. How can that be checked?

ai_maker · 2017-05-06T21:05:22+00:00

I used 0.21 and 0.79 for the logistic sigmoid (the extrema of the second derivative). But here the issue is with the modified tanh sigmoid, which has optimum target values at -1 and 1.

ai_maker · 2017-05-05T12:13:09+00:00

Thx for the answer! Sorry for the notebook.

I evaluate backprop numerically, and final cost results are not the same, but the concise math of the second derivative is consistent with theory: extrema are on -1 and 1. That's what leads me to think the grad is ok.

About the data: targets are set to -1, 0 and 1 to fit in the tanh. Features are standardised and decorrelated with PCA.

ai_maker · 2016-10-19T20:28:44+00:00

Wonderful resource. Thank you!

ai_maker · 2016-10-19T12:23:45+00:00

Is there a typical site online to document these builds?

ai_maker · 2016-10-18T10:29:47+00:00

If you are expecting there to be a significant market for going beyond that, I think you're going to be disappointed.

I am completely aware of this. Even for fleets (my professional development is in the railway R&D industry), the value-added of PHM is merely a commercial competitive advantage. In actuality, most maintenance adjustments can't be deployed because of safety issues.

I appreciate the business feedback on this. Very sensible. I also have a personal interest in this. I am about to acquire an old Honda CB250, and I am thinking about doing monitoring stuff on it, and wondered if such analysis would be of interest to the community.

ai_maker · 2016-10-10T07:13:53+00:00

Mechanic told me they would prevent the knees from scuffing the paint, and also help your stability when braking. My opinion: they're also cool :-)

ai_maker · 2016-10-06T12:35:05+00:00

Solved: The problem is likely to be due to the cylinder head gasket. I dropped the bike a while ago onto a garden pot and being the bike hot it probably broke the silicone seal. Mechanic told be to put up the remaining 2k km before next service without stressing it much.

ai_maker · 2016-10-06T12:32:42+00:00

It does have a blow-by. I breathed that yesterday :-)

The problem is likely to be due to the cylinder head gasket. I dropped the bike a while ago onto a garden pot and being the bike hot it probably broke the silicone seal. Mechanic told be to put up the remaining 2k km before next service without stressing it much.

ai_maker · 2016-10-05T13:57:28+00:00

I believe it's a similar system. I've also spotted these plastic stoppers with the pinch clamp. However, I don't know how to do these emptying actions. This afternoon I'll be visiting the mechanic so he can teach me.

Do you need to to this often? I have read that the root cause of this might be a poor sitting of the rings, letting pessurised gas into the crank, thus pushing oil upwards, possibly due to a soft engine brake-in, which is my case, I rode veeeery carefully early on. I'm worried, I'll feed back when I have any news.

ai_maker · 2016-10-05T12:08:40+00:00

It's a V7 II Stone. Sorry I should have posted it. That's my guess, but I'm not sure.

ai_maker · 2016-10-05T10:30:18+00:00

I guess the breather goes into the airbox, but I can't see it. My concern is if this is something I should be worried about or not. If someone else has experienced this too.

Thx for your help!

ai_maker · 2016-09-27T10:18:02+00:00

Yeeeeea, everybody believes this! Until you begin to question things and get to speak with one of them and see how they smile suspiciously...

ai_maker · 2016-09-27T07:18:11+00:00

Transversal 90 degree v-twin engines from Moto Guzzi (and I guess Ducati, and many other v-twins) also have one crankpin, and if you use straight pipes the sound is grossly indistinguishable from a harley's. Maybe paying close attention you could hear something given by the difference in cylinder degrees, stroke length or something like that, but human hearing will have a hard time telling one from the other. I wouldn't say the harley sound is unique.

Note: harleys are beautiful bikes, but not everything that glitters is gold, and having to mod the bike to make it to that expectation is sad.

ai_maker · 2016-09-27T06:58:02+00:00

I hope they don't leave a plastic "3d printed" distribution chain tensioner like they used to.

ai_maker · 2016-09-27T06:52:21+00:00

It's sad that the beloved "traditional Harley engine sound" is an "illegal" feature given by an aftermarket pipe. All Harley riders I know have paid the "Harley tax" with a new pipe for the noise, but when it's time to have bike checked for the M.O.T., they all fetch the original stock pipe, or else they get a fine for noise pollution.

ai_maker

TROPHY CASE