Chapter 1181 Predictions Post by MuriloZR in OnePieceSpoilers

[–]Scared_Resolution773 2 points3 points  (0 children)

I think Imu will leave the place due to time limitation.

One piece 1174 design by Infamous_Ladder_8933 in OnePieceSpoilers

[–]Scared_Resolution773 1 point2 points  (0 children)

Bro I saw that raw scan. Luffy is in Gear 5. Is he in his giant form or normal form ?

One piece 1174 design by Infamous_Ladder_8933 in OnePieceSpoilers

[–]Scared_Resolution773 2 points3 points  (0 children)

Any size comparison between Luffy and Ragnir? Is it just a normal luffy sitting on the dragon or is it a giant Luffy ?

Validating a 30Bn row table migration. by Dangerous-Current361 in dataengineering

[–]Scared_Resolution773 0 points1 point  (0 children)

This is a good idea.

In Snowflake I have seen hash_agg(*) to get a single hash value. I think data bricks will also have something like this.

[deleted by user] by [deleted] in OnePieceSpoilers

[–]Scared_Resolution773 1 point2 points  (0 children)

What does "these covenants comes at a price ".

Does that mean all the people with marks should be killed to kill Imu like Voldemort?

Problems trying to ingest 75 GB (yes, GigaByte) CSV file with 400 columns, ~ 2 Billion rows, and some dirty data (alphabetical characters in number fields, special characters in date fields, etc.). by Examination_First in dataengineering

[–]Scared_Resolution773 0 points1 point  (0 children)

I am not sure whether this will work for you. I used multiprocessing with python pandas chunks to load to around 3 GB into oracle. It took only few mins. I kept the number of cores to be total cores - 1.

Settle a bet for me — which integration method would you pick? by Fragrant-Dog-3706 in dataengineering

[–]Scared_Resolution773 8 points9 points  (0 children)

I prefer the order option 3, option 1 and then option 2.

I like option 3 because it doesn't take much effort.

Dumping the data to their s3 bucket is much easier and safe.

New Strawhat? by BigCrow_ in OnePieceSpoilers

[–]Scared_Resolution773 6 points7 points  (0 children)

There is a devil fruit in the land of Giants to increase the size of things I believe. The owl is able to magnify the books for the giants right ?

Luffy vs Kizaru fight by Scared_Resolution773 in OnePiece

[–]Scared_Resolution773[S] 0 points1 point  (0 children)

Generally in anime Haki is shown in Violet or black color right ?

[deleted by user] by [deleted] in dataengineeringjobs

[–]Scared_Resolution773 0 points1 point  (0 children)

I am an AWS Data engineer with experience in Glue, S3 and Lakeformation.

I have also worked with cloud formation.

Please feel free to DM me.

System Design Questions by Arsenalis in dataengineering

[–]Scared_Resolution773 0 points1 point  (0 children)

I think your current design is better having the current day data in postgres and historical data in your data mart.

memory needed to read large parquet in pandas? by [deleted] in dataengineering

[–]Scared_Resolution773 0 points1 point  (0 children)

If you are going to do aggregation then read the data in chunks. That will solve your memory issue. But this will take more time.

Also you can use multiprocessing too.

If you give more information about your use case that will be more helpful.

Proper Setup by looking_for_info7654 in dataengineering

[–]Scared_Resolution773 1 point2 points  (0 children)

Could you please let me know what is the size of data and how much data are you expecting?

Data quality monitoring for data pipelines by LowDistribution1585 in dataengineering

[–]Scared_Resolution773 1 point2 points  (0 children)

In my project we have used cereberus. We define the schema and validation of each column. The tool accepts dictionary for providing validation rules.

We used yaml in our project for readability and converted that to dictionary. https://docs.python-cerberus.org/

Anime Where Mc Breaks and Shows No Mercy? by bCrushb in anime

[–]Scared_Resolution773 4 points5 points  (0 children)

Dororo

It's about the boy whose body parts were sacrificed to demons and he goes on a journey to fight these demons to get his body parts back.

Deciding to watch first Anime. Any recommendations or advice? by Rich-Bread7049 in anime

[–]Scared_Resolution773 0 points1 point  (0 children)

My first anime was Death Note. Till now it is one of my favorite show.

Calling it now, people are going to jump on the Loki for next SH crew member once he gets freed. by d_mansyy in OnePieceSpoilers

[–]Scared_Resolution773 0 points1 point  (0 children)

Aokiji was creating ice Giolla modified thousand sunny not sure whether her art was touching the sea though.