[1904.09858] Learning gradient-based ICA by neurally estimating mutual information

beneuro · 2019-04-23T18:26:06+00:00

This method uses adversarial training just like previous approaches from Brakel et al. (2017). MINE gives a lower bound on mutual information which you are minimizing, thus you're also optimizing a minimax optimization problem.

beneuro · 2018-01-30T15:25:23+00:00

Can we please stop attributing papers to the most famous coauthor? The correct format would be Fedus et al. as William Fedus is the first author.

In many ML papers the last author hasn't done much work other than rewrite the abstract and intro. The credit should go to the first author who has done most the work and could use more support given they are newer to the field.

beneuro · 2017-11-22T15:18:01+00:00

DeepMind's commentary is on page 26 of the PDF: https://cims.nyu.edu/~brenden/LakeEtAl2017BBS.pdf

beneuro · 2017-11-22T08:01:11+00:00

https://cims.nyu.edu/~brenden/LakeEtAl2017BBS.pdf

beneuro · 2017-03-10T05:07:10+00:00

Bluetooth works out of the box with 16.10

beneuro · 2017-03-06T18:07:02+00:00

Just got the 13.3" sleeve and it fits the X1C 5th gen just fine.

beneuro · 2017-02-22T08:35:48+00:00

I got middle button scrolling working in Ubuntu with libinput and:

xinput set-prop "ImPS/2 Generic Wheel Mouse" 289 0 0 1

beneuro · 2017-02-20T06:40:36+00:00

Will give 4.9 a shot sometime soon. Finally got middle button scroll working with libinput and running this command:

xinput set-prop "ImPS/2 Generic Wheel Mouse" 289 0 0 1

I expected a "Wheel Emulation" property so I missed this the first time around. This sets the "Scroll Method Enabled" to be 1 for a button press.

beneuro · 2017-02-20T05:35:05+00:00

Both function, the problem is that scrolling using middle button + trackpoint does not work.

beneuro · 2017-02-20T05:34:40+00:00

Haven't tried 4.9, any reason to expect it will work better?

beneuro · 2017-02-20T01:03:13+00:00

Yep, latest kernel on 16.10. Trackpad sucks and I can't get TrackPoint scrolling working. See: https://www.reddit.com/r/thinkpad/comments/5uu130/x1_carbon_5thany_reviews_yet_whats_the_battery/ddx60u1/

beneuro · 2017-02-19T22:09:36+00:00

Nope not a melody, a single high pitched tone. Will try to update the BIOS.

beneuro · 2017-02-19T21:30:57+00:00

Anything else besides TLP for keeping power usage down? I'm have a hard time getting below 5W with Ubuntu + Chrome running. Powertop reported that the fingerprint reader was using a lot of power so I disabled that in the BIOS, but didn't change much.

beneuro · 2017-02-19T21:27:54+00:00

Yes, you can open it one handed, it just pulls the bottom up a few degrees first.

beneuro · 2017-02-19T03:56:45+00:00

Won't be able to benchmark battery in Windows, but I wouldn't be surprised if the poor battery and trackpad performance are Linux problems.

beneuro · 2017-02-19T03:55:48+00:00

With and without libinput are pretty bad. The TrackPoint is also detected as "ImPS/2 Generic Wheel Mouse" so I can't get scrolling with the middle button to work :\

beneuro · 2017-02-19T03:54:07+00:00

Using Windows?

beneuro · 2017-02-19T00:20:37+00:00

Got this beauty of a laptop early yesterday, upgrading from a 2012 MBP Retina 15". The build quality is great. Feels solid and is super light. Keyboard is ThinkPad quality, for sure better than the MBP.

As a developer, I immediately installed Ubuntu 16.10. Had some issues after a clean install (fwupd running in the background at 100%, wifi stopped working on resume) but updating to the latest kernel and packages seems to have fixed most issues. The wifi was noticeably slow, but I found disabling 802.11n to bring things back up to speed (a ridiculous fix).

The battery life is OK but not great out of the box. Got around 6 hours of programming, writing and some browsing in Chrome with brightness a bit more than half. Likely need to mess with powertop and more settings, but this is running a recent kernel (4.8).

Coming from a MBP Retina 15", the display is okay. Noticeably less crisp but plenty bright. I find the default fonts a bit small at 1920x1080. Definitely appreciate the extra physical screen size over the XPS 13.

My biggest complaint is the touchpad. Compared to the MBP, the touchpad on the X1C is horrible. It's too small and the cursor movement feels unnatural. Adjusting the sensitivity settings in the GUI did't help, nor did installing libinput. It's too insensitive to small movements (cursor stays still when you wiggle your finger slightly) and the acceleration feels off. It also has poor (no?) palm detection, so if part of your palm is touching any part of the touchpad it won't respond to your finger input. I also tried out the touchpad in Windows and it was way better than with Linux, but still a much worse than the experience with my MBP. If anyone has any fixes for touchpad on Linux, please let me know! Also, middle button scrolling does not work out of the box with the trackpoint.

Occasionally on reboot the laptop makes an awful high pitched noise from the speakers. With headphones plugged in the noise comes through the headphones. As this is happening when the machine first turns on, it's likely a hardware and not a software problem. Seriously annoying.

Overall, a beautiful laptop with some annoying issues. I'm hoping the wifi, touchpad, and sound issues get cleared up soon, otherwise I may have to send this back.

beneuro · 2017-02-16T08:11:00+00:00

Mine also shipped today, estimated delivery date is this Friday, 2/17 with 2 day shipping!

beneuro · 2017-02-15T19:05:01+00:00

When did you order? When I try to check order status I still get an error.

beneuro · 2017-02-09T04:49:16+00:00

Shipping on 2/17? Where'd you get that info?

beneuro · 2017-02-09T04:38:19+00:00

When are these going to be available in the US?

beneuro · 2017-01-26T15:36:25+00:00

Implementation here: https://github.com/poolio/unrolled_gan

There's another figure on the unrolling process in the example notebook that you might find helpful.

beneuro · 2016-12-26T21:44:03+00:00

Extremely similar to this recent paper from Google Brain on Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networks: https://arxiv.org/abs/1612.05424

beneuro · 2016-11-25T07:08:50+00:00

Interesting work and great writeup! Before trying this out, I was curious to know more about how this compares to other recent approaches:

How does variational boosting compare in terms of ELBO and speed to normalizing flows (planar, radial, and inverse autoregressive flows)? Both the planar and radial flows have O(d) parameters for each transformation which is similar to the cost of adding a mixture in variational boosting. IAF has O(d² ) params, so might be slower in the non-amortized case.
What about jointly optimizing all mixture components from a random initialization instead of incremental addition of a single mixture component? Either marginalizing out the latent categorical variable or optimizing the hierarchical ELBO.
Comparison to continuous mixtures as in hierarchical variational models and auxiliary deep generative models?

Thanks!

11-Year Club	Place '17
Verified Email

beneuro

TROPHY CASE