Handling failure with Azkaban -
there way control happens in azkaban after job fails, mean doing specific thing if specific job fails, lets load hive failed , want send error splank possible? or should create specific job insert , handle failure python
thanks
the way handle have following job runs script command
job type. have script check error condition , perform , action only if error found.
#!/bin/bash check=${./_check_script.sh $arg1 $arg2} if [ -z $check ]; echo "error found" ./_error_action.sh $arg1 $arg2 fi
note have allow script execution azkaban user (chmod +x
) scripts in before run them. not inherit permissions due use of .zip
upload format.
type=command command=chmod +x _alert_for_error.sh command.1=chmod +x _check_script.sh command.2=chmod +x _error_action.sh command.3=./_alert_for_error.sh
Comments
Post a Comment