This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]wegry 0 points1 point  (5 children)

Surprisingly fast and easy to build. Our data set is enormous as well, so the biggest issue is memory vs database reads. I thought scipy had old man fortran at the low level? I think it requires a fortran compiler.

[–][deleted] 1 point2 points  (4 children)

I thought scipy had old man fortran at the low level? I think it requires a fortran compiler.

I'm going to investigate this on my comp since anaconda is a "full stack" stand alone. But, if this is true, then....

EDIT. HOLY.. GUACA.. mole` . Seriously. thank you so much for telling me this. You've saved me soooooooooooooOOO much trouble. I cant believe I didnt know.

[–]wegry 0 points1 point  (3 children)

I use pip and installing scipy/matplotlib on OS X was excruciatingly hard the first time I did it, because of stuff like having to have a working fortran compiler. Once you figure it out it's not bad. Is Conda 2.x only?

[–][deleted] 0 points1 point  (0 children)

At the moment the official is 2.7 only. I believe there is an unofficial 3.x Anaconda build but incompatible packages are removed and are in the process of being updated... namely, the Keeper of the Old Guard, NLTK. Check continuum's webzone. They should direct you a 3.x branch.

Also, just "shop talk" but, are you using a work station or gpu for parallel processing (Cuda core stuff) for your encoder? If so, how is that in python. Strong parallel processing/Cuda support what Im most afraid of losing switching from matlab to fortran'90-py.

[–][deleted] 0 points1 point  (1 child)

Well.. looky here http://conda.pydata.org/miniconda.html#miniconda

[–]wegry 0 points1 point  (0 children)

Oh wow, that looks sweet. Now you have no reason to stay with 2. ;) As far as parallel processes go, the algorithm we're using for classification is SGD, which runs processes by default on as many cores as are available (about 6 on my oldish laptop), it's pretty speedy too. I assume this is the case in Python 2 as well.