hadoop - Caused by: java.lang.IllegalStateException: Job jobId] failed to start; status=FAILED -


mine spring yarn batch framework hadoop restart

getting following mentioned error:

2016-11-10 13:09:56.877  warn 28597 --- [           main] o.s.c.s.classpathxmlapplicationcontext   : exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.beancreationexception: error creating bean name 'wordcountjobrunner': invocation of init method failed; nested exception java.lang.illegalstateexception: job wordcountjobid] failed start; status=failed exception in thread "main" java.lang.reflect.invocationtargetexception         @ sun.reflect.nativemethodaccessorimpl.invoke0(native method)         @ sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl.java:57)         @ sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:43)         @ java.lang.reflect.method.invoke(method.java:606)         @ org.springframework.boot.loader.mainmethodrunner.run(mainmethodrunner.java:54)         @ java.lang.thread.run(thread.java:745) caused by: org.springframework.beans.factory.beancreationexception: error creating bean name 'wordcountjobrunner': invocation of init method failed; nested exception java.lang.illegalstateexception: job wordcountjobid] failed start; status=failed         @ org.springframework.beans.factory.support.abstractautowirecapablebeanfactory.initializebean(abstractautowirecapablebeanfactory.java:1578)         @ org.springframework.beans.factory.support.abstractautowirecapablebeanfactory.docreatebean(abstractautowirecapablebeanfactory.java:545)         @ org.springframework.beans.factory.support.abstractautowirecapablebeanfactory.createbean(abstractautowirecapablebeanfactory.java:482)         @ org.springframework.beans.factory.support.abstractbeanfactory$1.getobject(abstractbeanfactory.java:306)         @ org.springframework.beans.factory.support.defaultsingletonbeanregistry.getsingleton(defaultsingletonbeanregistry.java:230)         @ org.springframework.beans.factory.support.abstractbeanfactory.dogetbean(abstractbeanfactory.java:302)         @ org.springframework.beans.factory.support.abstractbeanfactory.getbean(abstractbeanfactory.java:197)         @ org.springframework.beans.factory.support.defaultlistablebeanfactory.preinstantiatesingletons(defaultlistablebeanfactory.java:772)         @ org.springframework.context.support.abstractapplicationcontext.finishbeanfactoryinitialization(abstractapplicationcontext.java:839)         @ org.springframework.context.support.abstractapplicationcontext.refresh(abstractapplicationcontext.java:538)         @ org.springframework.context.support.classpathxmlapplicationcontext.<init>(classpathxmlapplicationcontext.java:139)         @ org.springframework.context.support.classpathxmlapplicationcontext.<init>(classpathxmlapplicationcontext.java:83)         @ com.xx.poc.application.main(application.java:93)         ... 6 more caused by: java.lang.illegalstateexception: job wordcountjobid] failed start; status=failed         @ org.springframework.data.hadoop.mapreduce.jobexecutor$2.run(jobexecutor.java:221)         @ org.springframework.core.task.synctaskexecutor.execute(synctaskexecutor.java:50)         @ org.springframework.data.hadoop.mapreduce.jobexecutor.startjobs(jobexecutor.java:170)         @ org.springframework.data.hadoop.mapreduce.jobexecutor.startjobs(jobexecutor.java:162)         @ org.springframework.data.hadoop.mapreduce.jobrunner.call(jobrunner.java:52)         @ org.springframework.data.hadoop.mapreduce.jobrunner.afterpropertiesset(jobrunner.java:44)         @ org.springframework.beans.factory.support.abstractautowirecapablebeanfactory.invokeinitmethods(abstractautowirecapablebeanfactory.java:1637)         @ org.springframework.beans.factory.support.abstractautowirecapablebeanfactory.initializebean(abstractautowirecapablebeanfactory.java:1574)         ... 18 more exception in thread "main" java.lang.runtimeexception: java.lang.reflect.invocationtargetexception         @ org.springframework.boot.loader.mainmethodrunner.run(mainmethodrunner.java:62)         @ java.lang.thread.run(thread.java:745) caused by: java.lang.reflect.invocationtargetexception         @ sun.reflect.nativemethodaccessorimpl.invoke0(native method)         @ sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl.java:57)         @ sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:43)         @ java.lang.reflect.method.invoke(method.java:606)         @ org.springframework.boot.loader.mainmethodrunner.run(mainmethodrunner.java:54)         ... 1 more caused by: org.springframework.beans.factory.beancreationexception: error creating bean name 'wordcountjobrunner': invocation of init method failed; nested exception java.lang.illegalstateexception: job wordcountjobid] failed start; status=failed         @ org.springframework.beans.factory.support.abstractautowirecapablebeanfactory.initializebean(abstractautowirecapablebeanfactory.java:1578)         @ org.springframework.beans.factory.support.abstractautowirecapablebeanfactory.docreatebean(abstractautowirecapablebeanfactory.java:545)         @ org.springframework.beans.factory.support.abstractautowirecapablebeanfactory.createbean(abstractautowirecapablebeanfactory.java:482)         @ org.springframework.beans.factory.support.abstractbeanfactory$1.getobject(abstractbeanfactory.java:306)         @ org.springframework.beans.factory.support.defaultsingletonbeanregistry.getsingleton(defaultsingletonbeanregistry.java:230)         @ org.springframework.beans.factory.support.abstractbeanfactory.dogetbean(abstractbeanfactory.java:302)         @ org.springframework.beans.factory.support.abstractbeanfactory.getbean(abstractbeanfactory.java:197)         @ org.springframework.beans.factory.support.defaultlistablebeanfactory.preinstantiatesingletons(defaultlistablebeanfactory.java:772)         @ org.springframework.context.support.abstractapplicationcontext.finishbeanfactoryinitialization(abstractapplicationcontext.java:839)         @ org.springframework.context.support.abstractapplicationcontext.refresh(abstractapplicationcontext.java:538)         @ org.springframework.context.support.classpathxmlapplicationcontext.<init>(classpathxmlapplicationcontext.java:139)         @ org.springframework.context.support.classpathxmlapplicationcontext.<init>(classpathxmlapplicationcontext.java:83)         @ com.xx.poc.application.main(application.java:93)         ... 6 more caused by: java.lang.illegalstateexception: job wordcountjobid] failed start; status=failed         @ org.springframework.data.hadoop.mapreduce.jobexecutor$2.run(jobexecutor.java:221)         @ org.springframework.core.task.synctaskexecutor.execute(synctaskexecutor.java:50)         @ org.springframework.data.hadoop.mapreduce.jobexecutor.startjobs(jobexecutor.java:170)         @ org.springframework.data.hadoop.mapreduce.jobexecutor.startjobs(jobexecutor.java:162)         @ org.springframework.data.hadoop.mapreduce.jobrunner.call(jobrunner.java:52)         @ org.springframework.data.hadoop.mapreduce.jobrunner.afterpropertiesset(jobrunner.java:44)         @ org.springframework.beans.factory.support.abstractautowirecapablebeanfactory.invokeinitmethods(abstractautowirecapablebeanfactory.java:1637)         @ org.springframework.beans.factory.support.abstractautowirecapablebeanfactory.initializebean(abstractautowirecapablebeanfactory.java:1574)         ... 18 more 2016-11-10 13:10:01.750  info 28597 --- [nication thread] org.apache.hadoop.mapred.localjobrunner  : reduce > copy

my application context looks like:

<?xml version="1.0" encoding="utf-8"?> <beans xmlns="http://www.springframework.org/schema/beans"     xmlns:xsi="http://www.w3.org/2001/xmlschema-instance" xmlns:util="http://www.springframework.org/schema/util"     xmlns:context="http://www.springframework.org/schema/context"     xmlns:hdp="http://www.springframework.org/schema/hadoop" xmlns:batch="http://www.springframework.org/schema/batch"     xsi:schemalocation="     http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans.xsd     http://www.springframework.org/schema/hadoop http://www.springframework.org/schema/hadoop/spring-hadoop.xsd      http://www.springframework.org/schema/context  http://www.springframework.org/schema/context/spring-context.xsd      http://www.springframework.org/schema/batch http://www.springframework.org/schema/batch/spring-batch.xsd     http://www.springframework.org/schema/util http://www.springframework.org/schema/util/spring-util-4.2.xsd">      <context:property-placeholder location="classpath:application.properties" />     <hdp:configuration namenode-principal="hdfs://xx.yy.com" rm-manager-uri="xx.yy.com"         security-method="kerb" user-keytab="location" rm-manager-principal="username"         user-principal="username">         fs.default.name=${fs.default.name}         mapred.job.tracker=${mapred.job.tracker}     </hdp:configuration>      <hdp:job id="wordcountjobid" input-path="${input.path}"         output-path="${output.path}" jar-by-class="com.xx.poc.application"         mapper="com.xx.poc.map" reducer="com.xx.poc.reduce" />      <hdp:job-runner id="wordcountjobrunner" job-ref="wordcountjobid"         run-at-startup="true" /> </beans>

do need configuration or missing thing? error looks generic dont know how solve this.


Comments

Post a Comment

Popular posts from this blog

sql server - Cannot query correctly (MSSQL - PHP - JSON) -

i have little problem on project. , turns out query result returns nothing when value of first name or last name has 'ñ' in it. here's code config.php: <?php ini_set('mssql.charset', 'utf-8'); header('content-type: text/html; charset=utf-8'); $servername = "192.168.1.21"; /* ip add of db server */ $connection = array("database" => "db", "uid" => "?", "pwd" => "***"); $conn = sqlsrv_connect($servername, $connection); if(!$conn){ echo "connection not established."; die(print_r(sqlsrv_errors(), true)); } ?> myquery: $idnumber = $_post["idnum"]; $response = array(); $query2 = "select clname, cfname, cmname, cqualifier student cidno = '$idnumber'"; try{ $stmt2 = sqlsrv_query($conn, $query2); } catch(pdoexeption $ex){ $response["success"] = 0; $response["message"] = "d...
Read more

php - trouble displaying mysqli database results in correct order -

i have table in database stores events , date expire. want display events on website display current events first expired events after? i have tried following sql $sql = "select noticeid, notice, noticedesc, noticeimg, noticedate, expirydate tbl_notices group noticeid ,expired order expirydate asc"; but returns expired results first due expirydate being ordered asc in query. my tbl_notice structure looks this noticeid => int(4) notice => varchar(100) noticedesc => text noticedate => timestamp noticeimg => varchar(40) expirydate => datetime expired => int(1) 0 current or 1 expired my php code is $sql = "select noticeid, notice, noticedesc, noticeimg, noticedate, expirydate tbl_notices group noticeid ,expired order expirydate asc"; $result = mysqli_query($conn,$sql); if ($result->num_rows > 0) { // output data of each row while($row = $result->fetch_assoc()) { ...
Read more

C++ Linked List -

i trying create linked list download txt file , use linked list handle file line line. when handling downloaded linked list operations performed on such text editor would. encountering problems however. seems "node(string value)" section of code has wrong though original node() declaration no arguments passes. unable figure out quite is. node.h class node { public: node(); node(string value); void setnext(node *nextnode); // allows user set "next" pointer of node points friend class linkedlist; private: string data; // data box node* next; // pointer box }; node.cpp # include <string> # include "node.h" using namespace std; node::node() { data = ""; next = null; } node::node(string value) { data = value; next = null; } void node::setnext(node *nextnode) // allows user set "next" pointer of node points { this->next = nextnode; } your #include <string> ...
Read more