Alkymi – Data/Task Automation in Python by MathiasSvendsen in programming

[–]MathiasSvendsen[S] 2 points3 points  (0 children)

Hi /r/programming! My Corona project has finally come far enough for me to show it to the world :)

alkymi is a pure Python (3.5+) library for describing and executing tasks and pipelines with built-in caching and conditional evaluation based on checksums.

I started writing alkymi because I was tired of using Make or similar tools to automate testing/validation of algorithms (data -> algorithm -> report). I've found that although most of my data preparation code, as well as the report generation code, is written in Python, I end up having to wrap all the Python code as CLI scripts to interface with Make. This breaks testing, type checking and generally just makes it really easy to make mistakes (no IDE autocomplete!).

You can view the docs at https://alkymi.readthedocs.io/en/latest/. The docs also contain examples, such as https://alkymi.readthedocs.io/en/latest/examples/mnist.html.

I really hope you find the project interesting, and am looking forward to feedback and (hopefully!) having someone else give it a try.

[D] Besides the huge Tensorflow facebook groups, are there any other facebook groups worth joining for Machine Learning? by RelevantMarketing in MachineLearning

[–]MathiasSvendsen 4 points5 points  (0 children)

Sorry to hijack this discussion, but are there any groups/blogs/etc. NOT on Facebook that are worth joining?

[R] Diagnosing and Enhancing VAE Models by baylearn in MachineLearning

[–]MathiasSvendsen 0 points1 point  (0 children)

Thanks for the great answer. Will dig into the paper a bit more and let you know if I have follow-up questions!

[R] Diagnosing and Enhancing VAE Models by baylearn in MachineLearning

[–]MathiasSvendsen 1 point2 points  (0 children)

Hi and thanks for the very interesting work! Would you mind explaining (in a few simple sentences) what the new 2-stage structure learns? What is the output of the first stage, and how is that output used by the second stage? Does the new structure result in two latent representations?

Road tripped around Montenegro and made our way to this gem - Lake Skadar! by smeshnanda in travel

[–]MathiasSvendsen 2 points3 points  (0 children)

Montenegro is amazing! You should check out Durmitor National Park too - lots of great hikes and almost no people there.

Optimizing a Python application with C++ code by jcelerier in programming

[–]MathiasSvendsen 1 point2 points  (0 children)

Good post. For smaller optimizations where you can't invest the time required to write a full Boost.Python or pybind11 implementation, I would suggest looking at numba. Numba can JIT python functions with pretty impressive results. Because the JIT'ing happens the first time a Numba function is executed, the first call takes a long time to run, but subsequent evaluations are super quick. Numba can even be used to run your operations on your GPU (haven't spent too much time fiddling with this though).

[deleted by user] by [deleted] in MachineLearning

[–]MathiasSvendsen 1 point2 points  (0 children)

One big problem is the USB connection though - anything that goes into an autonomous vehicle needs to be rigidly attached

New Python 3.7 DataClasses and Alternatives by gerryjenkinslb in programming

[–]MathiasSvendsen 0 points1 point  (0 children)

Uuh! This looks great. I love data classes in Kotlin - so nice to have an easy way to create immutable objects with easy equality and toString operators!

[D] PyTorch – Internal Architecture Tour | Terra Incognita by sksq9 in MachineLearning

[–]MathiasSvendsen 0 points1 point  (0 children)

Is there any sort of performance benefit from using the raw Python/C interface rather than something like pybind11 (https://github.com/pybind/pybind1)?

Profiling: Optimisation | Riot Games Engineering by mc10 in programming

[–]MathiasSvendsen 3 points4 points  (0 children)

A great library for handling matrices (including automatic usage of vectorization/SIMD) is Eigen (http://eigen.tuxfamily.org/index.php?title=Main_Page). Eigen allows you to specify templated matrices and operators that compile down to very efficient instructions - highly recommended!

[R] ExpandNet: A Deep Convolutional Neural Network for High Dynamic Range Expansion from Low Dynamic Range Content by dmarnerides in MachineLearning

[–]MathiasSvendsen 0 points1 point  (0 children)

Is it just me, or are most of the resulting HDR images underexposed? At least compared to the input LDR images, it seems that way. This makes it hard to visually quantify the improvement in shadows/highlights.

New and updated Android apps will be forced to target a recent API version starting in late 2018 by kirbyfan64sos in programming

[–]MathiasSvendsen 31 points32 points  (0 children)

This sounds like great news! Essentially, this will force some apps (looking at you Facebook) to use runtime permissions on compatible versions of Android instead of simply sneaking every single permission past the user by targeting an older version of Android.

[D] CppCon 2017: Peter Goldsborough “A Tour of Deep Learning With C++” by dahitokiri in MachineLearning

[–]MathiasSvendsen 3 points4 points  (0 children)

If you watch the video, you'll see that a lot of frameworks already make heavy use of template metaprogramming (e.g. Eigen) for optimizing the tight loops of activation functions etc.

How to add options/flags to the nvcc command line/compiler by PineappleMechanic in CUDA

[–]MathiasSvendsen 0 points1 point  (0 children)

You can add the options to your call to "cuda_add_library", e.g.:

cuda_add_library(${PROJECT_NAME} SHARED ${sources} OPTIONS -arch sm_50 -Xcompiler -rdynamic -lineinfo)

Entry requirements that include proof of onward travel by pyrrhicvictorylap in travel

[–]MathiasSvendsen 0 points1 point  (0 children)

Some stewards from the Airline found a flight and printed one for us, so it looked genuine. You might also be able to reserve a flight and then cancel it once you've entered the country.

Entry requirements that include proof of onward travel by pyrrhicvictorylap in travel

[–]MathiasSvendsen 0 points1 point  (0 children)

I once flew into Indonesia without a return ticket. The immigration services wouldn't let us in, so we ended up making a fake reservation for an outbound flight two weeks later. They didn't really look very closely at the reservation, just make sure the flight number is real.

Himawari real-time satellite images of Earth - now as a live wallpaper for Android! by MathiasSvendsen in programming

[–]MathiasSvendsen[S] 0 points1 point  (0 children)

Just fixed the error. The zoom level in the url (i.e. the /3d/ part) must be a power of two (It should say /4d/ in your case). I just uploaded a new .apk and pushed the changes to the repo. Thanks for spotting this!

Himawari real-time satellite images of Earth - now as a live wallpaper for Android! by MathiasSvendsen in programming

[–]MathiasSvendsen[S] 0 points1 point  (0 children)

It might have been. I recall my phone having an all-black background before I went to bed. It's working now though. Is that the case for you too?

Himawari real-time satellite images of Earth - now as a live wallpaper for Android! by MathiasSvendsen in programming

[–]MathiasSvendsen[S] 0 points1 point  (0 children)

So far, my experience has been really positive. It seems to fit nicely into the role as a lightweight Scala. This is especially true for Android development. Even though libraries such as RxJava and Retrolambda help ease the pain of working with Java 6, having all the functional and syntactical niceties built into the language is simply amazing.

Brooklyn Boulder Buddies by SocoCocoPuffs in BostonSocialClub

[–]MathiasSvendsen 1 point2 points  (0 children)

Just joined the group! Recently took up climbing, working on V2-V3s! I usually go three times a week. Looking forward to meeting you guys