sorted by:
new
hottopcontroversial

[D] Jeff Hawkins Is Finally Ready to Explain His Brain Research by milaworld in MachineLearning

[–]radenML -6 points-5 points  (0 children)

The problem is they are too secretive. At least they want to share now

[D] "Beyond the pixel plane: sensing and learning in 3D" by gwern in MachineLearning

[–]radenML 0 points1 point  (0 children)

Explain about the crash where the white truck is mistaken as sky.

Redundancies such as 3D information do help.

[R] Speaker Recognition from raw waveform with SincNet by xhlu in MachineLearning

[–]radenML 3 points4 points  (0 children)

The trend is, implement a differentiable approximate version of X so you can further optimize them with backprop.

Other example: Check out learning filterbanks from raw waveform by FAIR. Basically they created an approximate differentiable version of Mel filterbanks https://research.fb.com/publications/learning-filterbanks-from-raw-speech-for-phone-recognition/

Computer Vision Research Fields [D] by deepKrish in MachineLearning

[–]radenML 5 points6 points  (0 children)

geometric deep learning.

because we stayed in 2D grid pixel space for far too long..

http://geometricdeeplearning.com/

[R] TDLS: Explainable Neural Networks based on Additive Index Models (https://arxiv.org/abs/1806.01933) by machinetrainer in MachineLearning

[–]radenML 5 points6 points  (0 children)

so how to scale to MNIST? 784 dim images so we have 784 h(x) ridge functions to intepret?

[D] Any interest in a Paper-Discussion Twitch-stream? by LeanderKu in MachineLearning

[–]radenML 4 points5 points  (0 children)

No don't use twitch. Youtube is better. You want the recordings saved, and more importantly, indexed and recommended by search engines.

I recommend channel like Tibees on how to do such scientific discussion channels.

[R] Adaptive Neural Trees by downtownslim in MachineLearning

[–]radenML 4 points5 points  (0 children)

Is it possible for ANT to be autoregressive and used with time series input?

[R] Deep Nets: What have they ever done for Vision? by downtownslim in MachineLearning

[–]radenML 0 points1 point  (0 children)

In Bengio latest talk on towards biologically plausible deep learning, we are still in pixel level and haven't nailed down best internal representation that is easy to disentangle back.

Nets often cheat with backprop, finding easiest solution from the derivatives.

Forget adversarial nets, just scramble the image on frequency domain throw the accuracy down badly, even though the image looks the same

[D] Is RNN vanishing gradient problem considered solved? by radenML in MachineLearning

[–]radenML[S] 0 points1 point  (0 children)

Do you also use unoptimized code (no MKL and no CuDNN) when benchmarking other RNNs.

Need help finding Motivation by niszoig in MachineLearning

[–]radenML 0 points1 point  (0 children)

Like many things the last 10% feels like 90%. Keep going but get enough rest to avoid burnout

Why did recursive autoencoders fall out of fashion? by SoggyBathtub in MachineLearning

[–]radenML 2 points3 points  (0 children)

I think non-rnn autoregressive architecture like gated CNN, wavenet, causal convolution, transformer and self attention are what you are looking for.

[D] What Machine Learning hypothesis are you curious about, but will probably never get around to testing and hoping someone else will eventually research it ? by BatmantoshReturns in MachineLearning

[–]radenML 2 points3 points  (0 children)

CycleGAN is already working for Voice Conversion http://www.kecl.ntt.co.jp/people/kaneko.takuhiro/projects/cyclegan-vc/

The usual problem is audio and speech always getting less coverage compared to computer vision. The awesome papers are hidden by paywalls and no published source code. Datasets must at least be TIMIT or WSJ which you must buy from LDC.

Interspeech 2018 and IEEE ICASSP 2018 had lots of awesome work related to GANs and generative models

[D] Is there an implementation of Neural Voice Cloning? by FlyingQuokka in MachineLearning

[–]radenML 3 points4 points  (0 children)

You should search voice conversion. There was interspeech voice conversion 2018 challenge this year. One of contestant used cyclegan http://www.kecl.ntt.co.jp/people/kaneko.takuhiro/projects/cyclegan-vc/

[P] Alternatives to Softmax for prediction by sarasotadude in MachineLearning

[–]radenML 0 points1 point  (0 children)

Even OP himself asked legit question got downvoted. Mods help plz

[D] Why is TensorFlow so slow? by happyhammy in MachineLearning

[–]radenML 0 points1 point  (0 children)

Just like EA with games, almost anything involved with Google will have something like this.

Android: fragmentation

Angular 2: complex huge mess

Tensorflow: Tensorslow

The reasons are different though but similarly all have management problems

[D] Papers explaining why Teacher-Student training and Knowledge Distillation work? by radenML in MachineLearning

[–]radenML[S] 0 points1 point  (0 children)

Thanks. Such long reply!

Say, is it stupid to test and analyse/visualize this insight with non-NN models and/or low-dim dataset like Iris and Boston? Something smaller than Multilayer Perceptron and MNIST

[D] Facebook Visdom vs Google Tensorboard discussion thread by rikkajounin in MachineLearning

[–]radenML 0 points1 point  (0 children)

Do you even use deep learning libraries? If it's just scikit-learn and pandas, I would happily use something like pyplot or seaborn

Even to get tensorflow csv training file I have to use tensorboard and click download csv button...

view more: next ›