java - How can I terminate EMR cluster when a step generated undesirable results in s3 -


My Amazon Simple Workflow spin an EMR cluster and adds a few steps that depend on the output of the previous step.

If I have 10 steps and my 6th phase generates output in C3, then to determine whether the phase can continue or the cluster can be eliminated on the basis of the output of the 6th stage, this 7 Things should be seen from the step. My work flow is going well, but how can I eliminate the cluster if the output is unwanted I am using AWS Java SDK

When you identify the problem, use the code below to terminate the cluster

You can use the code to launch the cluster

  AmazonElasticMapReduce emr = New AmazonElasticMapReduceClient (. // Job Flow RunJobFlowResult Results = emr.runJ ObFlow (request) // Close when you see an error Emr.shutdown ();  

Comments