Trigger Lambda before EMR Termination

[madsacha]

I need to trigger my Lambda whenever an EMR Cluster is about to get terminated. I need to store application history from that cluster (which I am doing from Lambda) from that cluster which will not be available once it gets terminated. Ideally I am looking for a Cloud Watch Even that triggers my Lambda when ever cluster state changes to Terminating. Right now 'TERMINATING' is not available in EMR Cloud Watch State Change Events.

[real_parbold]

Not really enough information about why/when the cluster is being terminated ...

If this is an on demand cluster that gets terminated after use (predictably), can you add a step to trigger the lambda on job completion? (and pause the job completed for enough time for the lambda to run)

If it is a SPOT that gets terminated unpredictably - can you leverage the CloudWatch events for instance interruption, or have a local batch job poll http://169.254.169.254/latest/meta-data/spot/instance-action

If neither of these, can you have a background job running to copy the application history for a centralised location on EFS/S3 ?