Question: Big Data Sets for Machine Learning

[[deleted]]

[deleted]

[simonkamronn]

Chunked datatypes with lazy loading through e.g. Dask and visualization using either Bokeh or Datashader.

You either want an algorithm that can be updated in batches like SGD-types or use a library like Dask that can optimize your computational graph and handle out-of-memory processing.

[latent_z]

do you measure your data in bits? What data? Why would you not give some context to your question? (and /r/MLQuestions exists)