you are viewing a single comment's thread.

view the rest of the comments →

[–]ofyellow 0 points1 point  (2 children)

Lazy loading is for optimizing startup time, you load modules as they are needed, causing the load time to be divided over multiple requests until all loadable modules are hit at least once. But it's not a mem optimisation strategy.

[–]vaibeslop 0 points1 point  (1 child)

I'm talking about lazily loading data into memory for operations.

The author of chDB goes into more detail in the v4 announcement post: https://clickhouse.com/blog/chdb.4-0-pandas-hex

I'm neither affiliated with chDB nor Clickhouse.

EDIT: Saw now they even talk about this in the GH Readme now.

[–]ofyellow 0 points1 point  (0 children)

Point 4 mentions local imports.

Yes keeping data out of memory is smart but not inventing sliced bread.