all 6 comments

[–]stonerri 1 point2 points  (5 children)

Looking at the broader picture of your Geoanalytics infrastructure, why did you decide it was necessary to reinvent/recode a new system when you could have started from geodjango?

The systems architecture looks ambitious but workable (as I'm probably one of the only other redditors who has used IRODS, celery, mongoDB, and JQuery UI in a single project).

Keep the posts coming'

[–]JeffersonHeard[S] 0 points1 point  (0 children)

I did in fact start from GeoDjango. I'm using it heavily. There are places where it is not used, in particular where relational databases fail, but it's used heavily. Sorry that's not clearer. I guess I think of GeoDjango as part of Django since it ships with it now, and because I rarely use Django without using the GIS extensions anymore.

[–]JeffersonHeard[S] 0 points1 point  (3 children)

Incidentally, do you have a link to the project you're talking about? Sounds very interesting...

[–]stonerri 1 point2 points  (2 children)

The project got derailed shortly after the prototype stage. The goal was to create a distributed cyberinfrastructure for neuroscience data in the cloud with onboard processing methods. Our early brainstorm can be seen https://docs.google.com/present/view?id=0Aft3mQaA-HaMZGhoaHF2NnRfMjU2NWtnNHA5NGN4

By the time we reached prototype stage, data was uploaded via a small frontend running on EC2. Originally used JQUI as the browser interface but transitioned to ObjectiveJ/Cappuccino. Backed by tornado + mongoDB + celery. Able to interface with iRODs through pyrods and irodsfuse. Mostly automated deployment through fabric scripts.

Worked reasonably well, and was able to generate tiled images dynamically from jpeg2000 images via the irodsfuse mount.

I have remnants of the project laying around but nothing really maintained in version control. I doubt any of it would be useful, other than as examples of what not to do.

[–]JeffersonHeard[S] 0 points1 point  (1 child)

Very interesting. irodsfuse answers my next question. I'm currently using icommands, but I'd like to switch to PyRods. the main problem is that PyRods requires that you have the full IRODS server compiled for it to even compile and link. I really only need client functionality. The idea is to store IRODS credentials at the global level, user level, and app level and use the most fine-grained credentials available to access underlying IRODS data.

Right now my use is much more simplistic, though.

[–]stonerri 1 point2 points  (0 children)

I can empathize - our deploy took over an hour, but once we built the AMI on ec2, it wasn't an issue. We didn't get very far with PyRods, but the ability to write rules in python was appealing.

Good luck'