Hive query error java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException -


hello executing hive query :

create table temp_session_orgid select     sorgid.property_num, sorgid.visitid, sorgid.fullvisitorid, sorgid.adate, sorgid.hits_customvariables_customvarvalue orgid     (         select             *,             row_number() on (partition property_num, visitid, fullvisitorid, adate order hitsid) rn         bt_hits_custom_vars         hits_customvariables_customvarname = 'orgid'     ) sorgid     sorgid.rn = 1 ;  hive:2.1.1 emr:5.3.1

where getting following error:

caused by: org.apache.hadoop.hive.ql.metadata.hiveexception: java.nio.channels.closedchannelexception @ org.apache.hadoop.hive.ql.exec.filesinkoperator.process(filesinkoperator.java:785) @ org.apache.hadoop.hive.ql.exec.operator.forward(operator.java:879) @ org.apache.hadoop.hive.ql.exec.selectoperator.process(selectoperator.java:95) @ org.apache.hadoop.hive.ql.exec.operator.forward(operator.java:879) @ org.apache.hadoop.hive.ql.exec.filteroperator.process(filteroperator.java:126) @ org.apache.hadoop.hive.ql.exec.operator.forward(operator.java:879) @ org.apache.hadoop.hive.ql.exec.ptfoperator$ptfinvocation.finishpartition(ptfoperator.java:373) @ org.apache.hadoop.hive.ql.exec.ptfoperator.process(ptfoperator.java:122) @ org.apache.hadoop.hive.ql.exec.operator.forward(operator.java:879) @ org.apache.hadoop.hive.ql.exec.selectoperator.process(selectoperator.java:95) @ org.apache.hadoop.hive.ql.exec.tez.reducerecordsource$groupiterator.next(reducerecordsource.java:348) ... 17 more caused by: java.nio.channels.closedchannelexception @ org.apache.hadoop.hdfs.dfsoutputstream.checkclosed(dfsoutputstream.java:1546) @ org.apache.hadoop.fs.fsoutputsummer.write(fsoutputsummer.java:104) @ org.apache.hadoop.fs.fsdataoutputstream$positioncache.write(fsdataoutputstream.java:60) @ java.io.dataoutputstream.write(dataoutputstream.java:107) @ org.apache.hadoop.hive.ql.io.hiveignorekeytextoutputformat$1.write(hiveignorekeytextoutputformat.java:87) @ org.apache.hadoop.hive.ql.exec.filesinkoperator.process(filesinkoperator.java:751) ... 27 more ], taskattempt 3 failed, info=[error: error while running task ( failure ) : attempt_1501196537592_0020_2_01_000000_3:java.lang.runtimeexception: java.lang.runtimeexception: org.apache.hadoop.hive.ql.metadata.hiveexception: hive runtime error while processing row (tag=0) {"key":{"reducesinkkey0":"89634781","reducesinkkey1":"1442844353","reducesinkkey2":"5186210141339993001","reducesinkkey3":"20150921","reducesinkkey4":"1"},"value":{"_col1":"customer"}} @ org.apache.hadoop.hive.ql.exec.tez.tezprocessor.initializeandrunprocessor(tezprocessor.java:211) @ org.apache.hadoop.hive.ql.exec.tez.tezprocessor.run(tezprocessor.java:168) @ org.apache.tez.runtime.logicalioprocessorruntimetask.run(logicalioprocessorruntimetask.java:370) @ org.apache.tez.runtime.task.taskrunner2callable$1.run(taskrunner2callable.java:73) @ org.apache.tez.runtime.task.taskrunner2callable$1.run(taskrunner2callable.java:61) @ java.security.accesscontroller.doprivileged(native method) @ javax.security.auth.subject.doas(subject.java:422) @ org.apache.hadoop.security.usergroupinformation.doas(usergroupinformation.java:1698) @ org.apache.tez.runtime.task.taskrunner2callable.callinternal(taskrunner2callable.java:61) @ org.apache.tez.runtime.task.taskrunner2callable.callinternal(taskrunner2callable.java:37) @ org.apache.tez.common.callablewithndc.call(callablewithndc.java:36) @ java.util.concurrent.futuretask.run(futuretask.java:266) @ java.util.concurrent.threadpoolexecutor.runworker(threadpoolexecutor.java:1142) @ java.util.concurrent.threadpoolexecutor$worker.run(threadpoolexecutor.java:617) @ java.lang.thread.run(thread.java:745)

what cause of error ? solution resolve error?


Comments

Post a Comment

Popular posts from this blog

php - Vagrant up error - Uncaught Reflection Exception: Class DOMDocument does not exist -

i've set bento/ubuntu-16.04 vagrant box using php 5.6, , getting following error quite few times when try , run shell script: "uncaught reflection exception: class domdocument not exist". i've tried adding following top of script (not together), each no success: "sudo apt-get install php5.6-xml", "sudo apt-get install php5-xml", "sudo apt-get install php-dom" i've tried resetting server "sudo service apache2 restart". does have suggestions?
Read more

vue.js - Create hooks for automated testing -

Image
qa guys complained can't automate frontend testing. because our html looks same outside. lazy hack did this <template> <div :role="$options.name"> ... </div> </template> <script> export default { name: 'vmcomponentname' } </script> which takes name script , applies html. in browser get: <div role="vmcomponentname"> ... </div> line :role="$options.name" goes in every component. is there dry er solutions? please share. additional details i'll explain in details looking for. imagine have vmusercreate form creates user. test case can create user . to automatically test without role, have use following selector: .wrapper > .wrapper > .wrapper > .submit-button the test extremely brittle (will break lot). if use roles can use [role="vmusercreateform"] .submit-button selector. many folds less brittle. so basically, i'm ...
Read more

Add new key value to json node in java -

i have json file : { "id":1, "name":"abc", "addressdetails": { "city":"newyork" } } i wanted add 1 more key-value ("pincode" : "414141") node 'addressdetails'. i tried using : objectmapper mapper = new objectmapper(); jsonnode root = mapper.readtree(new file("d://test.json")); objectnode node = mapper.createobjectnode(); node.with("addressdetails").put("pincode", "414141"); but it's not getting added, there way can ? you can try you should modify file path objectmapper mapper = new objectmapper(); objectnode nodes = mapper.readvalue(new file("d:\\test.txt"), objectnode.class); nodes.with("addressdetails").put("pincode", "414141"); mapper.writer().writevalue(new file("d:\\test.txt"), nodes);
Read more