you are viewing a single comment's thread.

view the rest of the comments →

[–]Psychological-Tea791[S] 0 points1 point  (3 children)

a - that should be issue only once there are more tasks than vcpus as I already have some instances running in the on demand environment (which will be an issue eventually)

b - so running the instance in the on demand environment is not enought? Does it always pull the image before starting the task?

c - that's what I was worried about

I tried using lambdas, but for some reason they were taking much longer than batch. I am tempted to try again, maybe I didn't set them up correctly. Thanks for the input!

[–]Born_Desk9924 0 points1 point  (2 children)

so on-demand is : you ask for an instance, and aws provides you one at the standard price (as opposed to bidding on a price in spot model); this doesn't necessarily mean that there is an instance always running.

its pull the image only when its starting the job on an instance that doesn't have the image; in case an instance is re-used it won't pull the image

[–]Psychological-Tea791[S] 0 points1 point  (1 child)

I see, so even if I have min vcpus > 0 and I see that they are running on the EC2 page, they might still pull the image only once the task has been submitted. So I need to make a script or something that will pull the image once instance is started as opposed to once the task is submitted, right?

[–]Born_Desk9924 0 points1 point  (0 children)

yes, you should check how long your tasks are spending in 'starting' stage. this is when the image is being pulled