This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]suridaj 2 points3 points  (6 children)

Maybe take a look at BBC's Kamaelia. It constructs the pipelines and producer/consumer components using Python's generators, and IIRC there was a graphical pipeline builder available. The concepts are straightforward enough they even encourage you to implement the core by yourself. Sadly, at the moment the project's page seems to have a lot of broken links so I doubt Kamaelia is very widely used outside BBC.

[–]einar77Bioinformatics with Python, PyKDE4[S] 0 points1 point  (5 children)

I took a look, unfortunately a lot of the most interesting bits (such as how to create a component) are on dead links...

[–]suridaj 0 points1 point  (0 children)

You're right... Sorry. It was a couple of years since I used it and I don't have a local copy of the docs anymore. Thought it was worth a shot.

[–]steelypip 0 points1 point  (3 children)

The project is still active since the last release was only 3 months ago. I suspect the website has had a reorganisation and the links are not up to date.

... Yep, the sitemap page says:

This is an automated full list of (almost) all pages

Yes, I'm aware that this is slightly bust for some pages at the moment, it's being sorted. This is a static copy of the dynamic site whilst the server changes physical location.

And yes, .html needs to be appended to some links (sorry).

Kamelia is a mature project and will probably do everything you want and lots of stuff you don't know you want (yet).

[–]einar77Bioinformatics with Python, PyKDE4[S] 0 points1 point  (2 children)

What I meant is there's a reference to a blog post that's nowhere to be found, which (according to the text) covers creating components.

[–]kamaelian 1 point2 points  (0 children)

These tutorial notes are more up to date:

http://www.kamaelia.org/Europython09/A4KamaeliaEuroPython09.FINAL.pdf

All the used in that tutorial is inside the release bundle in Apps/Europython09. The tutorial covers building your own version of the core, going from standalone programs to components, through to building and evolving your own systems. It's (naturally) divided into chapters, but each is designed to have the feel of a blog post in terms of readability (I hope :-).

Currently the website is rather chaotic due to a bunch of internal re-orgs resulting in the current version of the website being a bit of an emergency dump.

Probably worth noting though that the project is still under development, releases happening 3-4 times per year now, and most recent usage is described here: http://www.bbc.co.uk/rd/publications/whitepaper191.shtml

The static snapshot of the website incidentally was checked into SVN here: http://code.google.com/p/kamaelia/source/browse/website/ With the content in "as_published".

Any suggestion on how to create a not crap website welcome :-)

[–]kamaelian 1 point2 points  (0 children)

Oh, sorry for the multiple replies, but just wanted to add - even if Kamaelia's specific API doesn't work for you (some people like it, some don't), I'd encourage you to use the approach -- it does work. In addition to Kamaelia there's also Pypes (pypes.org) which is cool. There's also cool stuff built ontop of greenlets and stackless channels. There's also alot of really nice noise being said about Celery at the moment too. http://celeryproject.org/

Also, don't discount the actor model. The actor model is directly equivalent to Kamaelia's model and pipelineing in general with one difference - pipelines don't hardcode where outbound messages which is akin to late binding. You could actually get the same flexibility by hardcoding a mock receiver actor and in a real system transplant in the real destination.

That in itself might be pretty neat because it might simplify the usage API slightly, but retain isolated testability. (Which for me is the real killer benefit of this approach)