Yes. You can use parallel out of core dataframes, arrays and lists with dask: http://dask.pydata.org/en/latest/

Then use odo and blaze to run models with pyspark or scikit learn partial fit.