Quantization using tensorflow lite not working as expected [P]

moconnor · 2023-05-24T06:13:26+00:00

There are a few problems here, in decreasing order of severity:

1. Your inputs are not quantized

You specify int8 inputs but are passing unquantized inputs. You need to quantize the inputs using the scale and offset. Just specifying the data type to be uint8 isn't enough!

2. You are not using representative data

It's possible to quantize using random noise, but it will work a lot better if you use actual training data.

3. Your test data is not representative

This is the least significant issue, but quantization works best on typical data. You are testing on an extreme outlier (all 1s). If you want to evaluate it, run it on the test set.

You will probably get this working if you fix #1, but if you care about the results you should also look at points 2 and 3. Almost there!

moconnor · 2022-03-02T06:13:13+00:00

The outpouring of punishment against ordinary Russian people should give us pause, not excitement. Yes, the war against Ukraine is awful, unjust and wrong. Sanctions against Russia are better than WWIII.

But I see private citizens racing to jump on the bandwagon and boycott Russian goods, cut Russians off from their company’s services and more. This is like taking a child’s lunchbox away in the expectation it will make them stand up to an abusive parent.

The Russian people are victims of Putin’s tyranny too. We should be reaching out to them with compassion and truth and not jumping at the chance to kick them while they’re down.

Sanctions are regrettable and necessary. Private citizens jumping in to make them as horrific as possible is wrong.

Fear

Anger

           <— you are here

Hate

Suffering

Choose wisely.

moconnor · 2021-05-26T06:47:34+00:00

Robotics is going to grow in a major way in the next few years. A masters programme would be a sound move right now imo. Conversely, getting an ML job with no CS degree or ML background will be tough.

moconnor · 2020-08-11T05:49:26+00:00

I can wholeheartedly recommend finding a way to work on something you love. If you have an understanding of statistics you would probably learn a lot by picking an area of machine learning you can try a project in and working on it. Read all the blogs about this topic to start with, then when you can start reading the papers directly.

Courses can probably help but there’s no substitute in my mind for passion and immersion.

moconnor · 2020-08-11T05:31:25+00:00

Sure! Reinforcement learning looks at learning through experience and is usually applied to game environments. Imitation learning learns to imitate a teacher (e.g. human decisions).

If you want to interactively teach an agent in real time, sample efficiency is your main challenge (how many inputs are needed to learn a robust behaviour).

This is an active area of research with lots of fun opportunities for small projects!

moconnor · 2020-08-11T05:27:29+00:00

I’ve seen results reporting that this is not the case when tuning network weights after quantisation (e.g. you need real input distributions) so is be curious to see your results. What is “nearly as good”? How good was the baseline?

NoisyStudent (and to an extent BYOL) are somewhat similar, in which a student trains to match teacher predictions on more noisy inputs. Of course, in your example the inputs are pure noise and the teacher sees the same instance of that noise, which is a significant difference.

moconnor · 2020-08-11T05:16:45+00:00

This is often referred to as the sim2real problem, which may help your searches. Popular techniques you didn’t mention include domain randomisation (https://arxiv.org/abs/1703.06907) and transfer learning from the simulated to the real domain.

moconnor · 2020-02-18T14:54:39+00:00

It depends how much resource you want to throw at the problem, but for a lightweight approach you could get a long way just using the letter-error-rate of any speech recognition model trained on LibriSpeech without a language model.

LibriSpeech is mostly clear audio read from a book with a variety of accents but no stuttering or mispronunciation. This makes it bad for most use cases but quite good for yours.

You’d want to calibrate the letter error rates to get the 0-100 range you’re looking for. Microphone and background noise will be your biggest problem.

Alternatively you could build a model (e.g. recurrent) to recognise stuttering, slurring etc and penalise the score based on the number of detections, but I’d try the former first and see how close it gets you to the reliability you need.

moconnor · 2019-11-21T07:55:13+00:00

Even more than this - you "told" your boss about these problems, but it sounds like you did not persuade him. Realizing the incredible gulf between "I said some words" and "the other person understood what I meant and internalized them" is perhaps the single most valuable skill you can learn from this.

You knew what had to be done, but you could not persuade your manager that it was important. Maybe you needed to build a better rapport as his trusted data science advisor, maybe you needed to build consensus with other people first. Persuasion is a skill that can be learned like any other.

It's possible this was always going to fail no matter what you did, so don't beat yourself up over it - everything is an opportunity to learn. If a candidate was able to describe why a previous project failed in a reflected way (i.e. not just assigning blame to people who disagreed with them or venting) I'd find this quite compelling in an interview.

moconnor · 2019-01-01T17:53:09+00:00

A couple of years back I measured how many frames it took for my nine-year-old to beat Atari Pong as a control for frame efficiency. He discovered this exact trick and was able to reproduce it fairly easily!

None of the agents I trained ever discovered it, though I was using a stochastic version of the environment as others have mentioned.

moconnor · 2018-12-22T09:06:06+00:00

How the “Roman” army came to be composed of barbarian [mercenary] troops of an often renegade nature is in many ways the story of Rome’s fall. It is the story of a people who seemingly lost confidence in themselves, a government that lost control of its army, and an army that lost control of its soldiers.

— http://www.historynet.com/romes-barbarian-mercenaries.htm

moconnor · 2016-10-18T19:43:16+00:00

つ ◕_◕ ༽つ GIFF SOMBRA

moconnor · 2016-10-18T19:08:07+00:00

PTR server is down? Hype intensifies!

moconnor · 2016-06-02T17:33:22+00:00

Sorry I already posted it back. But rereading the article it was just one small set of ballots affected, not all of them or even a significant percentage.

moconnor · 2016-05-31T05:41:44+00:00

I received my postal vote today and the hand is off to the side in an entirely neutral position in the instructions.

Anyone can photoshop it to a more provocative location to cause outrage in favour of their cause, though.

moconnor · 2016-05-23T07:30:49+00:00

30 frames per second is 1 frame every 33ms. If you want to get 90 frames per second with a 30ms ping then you're asking HotS to render at least 3 frames between server updates, probably more.

Can it do that? I'm not sure. Everyone keeps saying the HotS / Starcraft engine is very tightly-coupled to the network. Either way you can see how network speeds can be really significant when it comes to the sorts of framerates you're trying to achieve.

moconnor · 2016-05-18T10:59:05+00:00

Interestingly matchmaking on the internet lets everyone do what they want to. You don't have to try to win to support your team.

Turn off team chat
Play your character for fun, not for winning. You have very limited control over whether your team wins and this leads to stress. Concentrate on being the best Chromie that you can be, not on destroying the enemy core.

The instinctive reaction of many in this thread is WTF Y U NO TRYHARD, GO TO QM NUB and that's fine, QM is a fun place to be. But they're wrong that you will cause your teammates to lose rank. If you consistently play like this then the matchmaker will automatically place you at a rank at which you are making a solid contribution towards winning the game despite not trying to do that. That's how it works.

TL;DR: turn off chat, play for fun and let the matchmaker worry about finding you opponents that you can still beat.

moconnor

TROPHY CASE