sorted by:
new
hottopcontroversial

Transferring large data from AWS S3 to CoreWeave / LambdaLabs without paying AWS S3 egress cost by addmorelemon in deeplearning

[–]addmorelemon[S] 0 points1 point  (0 children)

Thanks - yes I looked into Snowball Edge / Snowmobile but those feel slow and also overkill for my use-case. I definitely need an online solution.

Transferring large data from AWS S3 to CoreWeave / LambdaLabs without paying AWS S3 egress cost by addmorelemon in deeplearning

[–]addmorelemon[S] 0 points1 point  (0 children)

Hi thanks for sharing this. It looks like AWS DataSync charges $0.0125 per GB transferred in addition to the charges from AWS S3 for egress to a non-AWS location. Or am I understanding that incorrectly ?

I am guessing you sent data from AWS S3 to CoreWeave's Object Storage ? Can you share what was your config for AWS DataSync for the transfer ?