EDP jobs execution fails using vanilla hadoop
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Sahara |
New
|
Undecided
|
Unassigned |
Bug Description
Using sahara-tests to run the scenario test on the pike version sahara, but the EDP job execution fails for most of them.
sahara-tests run below the six jobs, and the cluster creation and verification is successful:
pig_job mapreduce_job mapreduce_
java_job
hive_job
spark_wordcount
only java job is succeeded, others get killed or error. Three types of errors from oozie are like below:
2017-12-13 00:57:17,956 WARN MapReduceAction
java.lang.
2017-12-13 00:59:09,140 WARN PigActionExecut
2017-12-13 00:57:43,741 WARN HiveActionExecu
java.lang.
Tried to run the pig script manually on the existing cluster, the result is same. (Launcher error then get kiiled)
This seems interesting: org.apache. hadoop. fs.swift. snative. SwiftNativeFile System not found
Is the image generated using sahara- image-elements?