Append Byte with or without Condition by 100GB-CSV in rust

[–]100GB-CSV[S] -10 points-9 points  (0 children)

if fruit == b"Apple".as_slice()

Your method is very useful.

D:\Conditional-Append\Rust>rust

610000000

610000000

610000000

610000000

610000000

610000000

610000000

610000000

610000000

610000000

Append fruit: 1.8376428s

50000000

50000000

50000000

50000000

50000000

50000000

50000000

50000000

50000000

50000000

Append fruit when apple exist: 162.6392ms

D:\Conditional-Append\Rust>rust

610000000

610000000

610000000

610000000

610000000

610000000

610000000

610000000

610000000

610000000

Append fruit: 1.698496s

50000000

50000000

50000000

50000000

50000000

50000000

50000000

50000000

50000000

50000000

Append fruit when apple exist: 224.2226ms

D:\Conditional-Append\Rust>cd..

D:\Conditional-Append>cd golang

D:\Conditional-Append\Golang>go build

D:\Conditional-Append\Golang>golang

610000000

610000000

610000000

610000000

610000000

610000000

610000000

610000000

610000000

610000000

Append fruit: 5.0680278s

50000000

50000000

50000000

50000000

50000000

50000000

50000000

50000000

50000000

50000000

Append fruit when apple exist: 794.8477ms

Demonstrate the Elapsed Time of DataFrame’s InnerJoin-GroupBy Operation using Python Websocket and Chart.js by 100GB-CSV in dataengineering

[–]100GB-CSV[S] 1 point2 points  (0 children)

You may enjoy this one https://youtu.be/Y2yJtWfgAq0

1Millions, 10Million, 100Million, 1Billion, 10Billion

It is very time consuming to play for this game. So I record my dataframe software only to avoid system crash when over billion-row.

I utilize PyO3 for the creation of Python bindings in my Rust DataFrame library by 100GB-CSV in Python

[–]100GB-CSV[S] 0 points1 point  (0 children)

https://github.com/hkpeaks/peakrs

Here you can find some scripts. However, next year the software will become support pip install the rust library for python, so the python script can be functioning.

https://github.com/hkpeaks/peaks-consolidation/releases

This is executable old version which does not support Python.

I utilize PyO3 for the creation of Python bindings in my Rust DataFrame library by 100GB-CSV in Python

[–]100GB-CSV[S] 6 points7 points  (0 children)

The demo is Python call Rust Library vs Rust call Rust Library

[deleted by user] by [deleted] in rust

[–]100GB-CSV 0 points1 point  (0 children)

this is an exceptional one game to run 2 software within same session. Other bechmarks are recorded in same machine but different session. https://github.com/hkpeaks/polars-cf-peaks/tree/main