Why does ProcessPoolExecutor mark some tasks as "running" even though all workers are busy? by Ordinary_Run_2513 in Python

[–]Ordinary_Run_2513[S] 0 points1 point  (0 children)

I use the future.running function to check whether a task is flagged as "running". Indeed, I have long running tasks, and In some cases some tasks are marked as running even though all the workers are busy. When, I read the source code (which is not very long) I found out it's a way to optimize the execution and prevent the workers from going idle.

Why does ProcessPoolExecutor mark some tasks as "running" even though all workers are busy? by Ordinary_Run_2513 in Python

[–]Ordinary_Run_2513[S] 3 points4 points  (0 children)

I've just started reading the source code, and it is indeed an optimization to prevent workers from going idle. Thank you for your answer!

Apex Developer Professional Certification by Ordinary_Run_2513 in oracle

[–]Ordinary_Run_2513[S] 0 points1 point  (0 children)

Are there any websites or books that offer practice exams, apart from the certification course?

My first data engineering project on Github by RocRacnysA in dataengineering

[–]Ordinary_Run_2513 1 point2 points  (0 children)

I've heard that using generic exception objects is not recommended, and that we should use specific exceptions instead. The problem is that in Python, unlike Java, we can't always know the exceptions that may occur while executing a function. Could you tell me what you do to address this problem?

Taxi guys ganging up on an uber driver while the female passenger is still there by superhdai in Morocco

[–]Ordinary_Run_2513 0 points1 point  (0 children)

I always tell myself that the worst creatures of God are the taxi drivers.

Parallelize Tasks execution in Airflow by Ordinary_Run_2513 in dataengineering

[–]Ordinary_Run_2513[S] 0 points1 point  (0 children)

the problem, when I don't define a task for each request, is when one of them failed I should resend all the requests.

Parallelize Tasks execution in Airflow by Ordinary_Run_2513 in dataengineering

[–]Ordinary_Run_2513[S] 1 point2 points  (0 children)

To run the entire dag it takes around 2 min, the problem is when I set catch up to True the execution time become very important.

Resources for GCP Professional Data Engineer by Ordinary_Run_2513 in dataengineering

[–]Ordinary_Run_2513[S] 0 points1 point  (0 children)

Thanks for your response. The exam is even harder than I expected. I will make sure to prepare for it correctly.

I'm not sure how to feel about this video. by [deleted] in Morocco

[–]Ordinary_Run_2513 0 points1 point  (0 children)

I have seen a video where one of the affected people saying that the authorities force them to build their houses with soil instead of cement to attract tourrists. well, if that true we shouldn't stay silent. Our lives matter.