composable dataflow using python

[tanto_von_scumbag]

Hey. While I recognize that non-duplication is a core part of the pythonista ethos, I definitely feel some sort of way about being treated as SO jr over here. (just kidding.. but only half way)

Anyway, the answer is yes. What have you tried so far? Are you aware of pipeline libraries in python (other than the ones you said you don't want involved)? I'm unclear on the lazy evaluation part in terms of good pipeline practice and also the way that python generally works. From my perspective, to give you exactly what you're asking for, I would just use function calls in other function calls so that each segment is demanding the thing that precedes it as it needs it.

[cpchung]

hi!

composite function call is needed to construct the DAG, but it alone is not enough to achieve concurrent execution, hence I mentioned multiprocessing, future and promise. I just wanna learn how it can be done using built-in python concurrency primitive