spark streaming org.apache.hadoop.metrics2.MetricsException: Metrics source ZooKeeper,sub=ZOOKEEPER already exists! after spark-submit -


i creating spark-streaming application reads , write hbase application executes fine in eclipse while executing spark-submit gives exception:

spark-submit --master local[*] --class userprofile --name realtimeuserprofiling realtimeuserprofiling.jar

error executor.executor: exception in task 3.0 in stage 400.0 (tid 215)      java.io.ioexception: java.lang.reflect.invocationtargetexception     @ org.apache.hadoop.hbase.client.connectionfactory.createconnection(connectionfactory.java:221)     @ org.apache.hadoop.hbase.client.connectionfactory.createconnection(connectionfactory.java:114)     @ hbaseutils.getconnection(hbaseutils.java:55)     @ hbaseutils.<init>(hbaseutils.java:42)     @ userprofile$4.call(userprofile.java:129)     @ userprofile$4.call(userprofile.java:1)     @ org.apache.spark.streaming.api.java.javadstreamlike$$anonfun$fn$4$1.apply(javadstreamlike.scala:205)     @ org.apache.spark.streaming.api.java.javadstreamlike$$anonfun$fn$4$1.apply(javadstreamlike.scala:205)     @ org.apache.spark.rdd.rdd$$anonfun$mappartitions$1$$anonfun$apply$20.apply(rdd.scala:710)     @ org.apache.spark.rdd.rdd$$anonfun$mappartitions$1$$anonfun$apply$20.apply(rdd.scala:710)     @ org.apache.spark.rdd.mappartitionsrdd.compute(mappartitionsrdd.scala:38)     @ org.apache.spark.rdd.rdd.computeorreadcheckpoint(rdd.scala:306)     @ org.apache.spark.rdd.rdd.iterator(rdd.scala:270)     @ org.apache.spark.scheduler.shufflemaptask.runtask(shufflemaptask.scala:73)     @ org.apache.spark.scheduler.shufflemaptask.runtask(shufflemaptask.scala:41)     @ org.apache.spark.scheduler.task.run(task.scala:89)     @ org.apache.spark.executor.executor$taskrunner.run(executor.scala:213)     @ java.util.concurrent.threadpoolexecutor.runworker(threadpoolexecutor.java:1142)     @ java.util.concurrent.threadpoolexecutor$worker.run(threadpoolexecutor.java:617)     @ java.lang.thread.run(thread.java:748)   caused by: java.lang.reflect.invocationtargetexception     @ sun.reflect.generatedconstructoraccessor22.newinstance(unknown source)     @ sun.reflect.delegatingconstructoraccessorimpl.newinstance(delegatingconstructoraccessorimpl.java:45)     @ java.lang.reflect.constructor.newinstance(constructor.java:423)     @ org.apache.hadoop.hbase.client.connectionfactory.createconnection(connectionfactory.java:219)     ... 19 more   caused by: java.lang.runtimeexception: not create  interface org.apache.hadoop.hbase.zookeeper.metricszookeepersource hadoop compatibility jar on classpath?     @ org.apache.hadoop.hbase.compatibilitysingletonfactory.getinstance(compatibilitysingletonfactory.java:75)     @ org.apache.hadoop.hbase.zookeeper.metricszookeeper.<init>(metricszookeeper.java:38)     @ org.apache.hadoop.hbase.zookeeper.recoverablezookeeper.<init>(recoverablezookeeper.java:130)     @ org.apache.hadoop.hbase.zookeeper.zkutil.connect(zkutil.java:137)     @ org.apache.hadoop.hbase.zookeeper.zookeeperwatcher.<init>(zookeeperwatcher.java:134)     @ org.apache.hadoop.hbase.zookeeper.zookeeperwatcher.<init>(zookeeperwatcher.java:108)     @ org.apache.hadoop.hbase.client.zookeeperkeepaliveconnection.<init>(zookeeperkeepaliveconnection.java:43)     @ org.apache.hadoop.hbase.client.connectionimplementation.getkeepalivezookeeperwatcher(connectionimplementation.java:1229)     @ org.apache.hadoop.hbase.client.zookeeperregistry.getclusterid(zookeeperregistry.java:102)     @ org.apache.hadoop.hbase.client.connectionimplementation.retrieveclusterid(connectionimplementation.java:526)     @ org.apache.hadoop.hbase.client.connectionimplementation.<init>(connectionimplementation.java:288)     ... 23 more   caused by: java.util.serviceconfigurationerror: org.apache.hadoop.hbase.zookeeper.metricszookeepersource: provider org.apache.hadoop.hbase.zookeeper.metricszookeepersourceimpl not instantiated     @ java.util.serviceloader.fail(serviceloader.java:232)     @ java.util.serviceloader.access$100(serviceloader.java:185)     @ java.util.serviceloader$lazyiterator.nextservice(serviceloader.java:384)     @ java.util.serviceloader$lazyiterator.next(serviceloader.java:404)     @ java.util.serviceloader$1.next(serviceloader.java:480)     @ org.apache.hadoop.hbase.compatibilitysingletonfactory.getinstance(compatibilitysingletonfactory.java:59)     ... 33 more   caused by: org.apache.hadoop.metrics2.metricsexception: metrics source zookeeper,sub=zookeeper exists!     @ org.apache.hadoop.metrics2.lib.defaultmetricssystem.newsourcename(defaultmetricssystem.java:135)     @ org.apache.hadoop.metrics2.lib.defaultmetricssystem.sourcename(defaultmetricssystem.java:112)     @ org.apache.hadoop.metrics2.impl.metricssystemimpl.register(metricssystemimpl.java:228)     @ org.apache.hadoop.hbase.metrics.basesourceimpl.<init>(basesourceimpl.java:115)     @ org.apache.hadoop.hbase.zookeeper.metricszookeepersourceimpl.<init>(metricszookeepersourceimpl.java:56)     @ org.apache.hadoop.hbase.zookeeper.metricszookeepersourceimpl.<init>(metricszookeepersourceimpl.java:51)     @ sun.reflect.generatedconstructoraccessor24.newinstance(unknown source)     @ sun.reflect.delegatingconstructoraccessorimpl.newinstance(delegatingconstructoraccessorimpl.java:45)     @ java.lang.reflect.constructor.newinstance(constructor.java:423)     @ java.lang.class.newinstance(class.java:442)     @ java.util.serviceloader$lazyiterator.nextservice(serviceloader.java:380)     ... 36 more

please me ?


Comments

Post a Comment

Popular posts from this blog

php - Vagrant up error - Uncaught Reflection Exception: Class DOMDocument does not exist -

i've set bento/ubuntu-16.04 vagrant box using php 5.6, , getting following error quite few times when try , run shell script: "uncaught reflection exception: class domdocument not exist". i've tried adding following top of script (not together), each no success: "sudo apt-get install php5.6-xml", "sudo apt-get install php5-xml", "sudo apt-get install php-dom" i've tried resetting server "sudo service apache2 restart". does have suggestions?
Read more

vue.js - Create hooks for automated testing -

Image
qa guys complained can't automate frontend testing. because our html looks same outside. lazy hack did this <template> <div :role="$options.name"> ... </div> </template> <script> export default { name: 'vmcomponentname' } </script> which takes name script , applies html. in browser get: <div role="vmcomponentname"> ... </div> line :role="$options.name" goes in every component. is there dry er solutions? please share. additional details i'll explain in details looking for. imagine have vmusercreate form creates user. test case can create user . to automatically test without role, have use following selector: .wrapper > .wrapper > .wrapper > .submit-button the test extremely brittle (will break lot). if use roles can use [role="vmusercreateform"] .submit-button selector. many folds less brittle. so basically, i'm ...
Read more

Add new key value to json node in java -

i have json file : { "id":1, "name":"abc", "addressdetails": { "city":"newyork" } } i wanted add 1 more key-value ("pincode" : "414141") node 'addressdetails'. i tried using : objectmapper mapper = new objectmapper(); jsonnode root = mapper.readtree(new file("d://test.json")); objectnode node = mapper.createobjectnode(); node.with("addressdetails").put("pincode", "414141"); but it's not getting added, there way can ? you can try you should modify file path objectmapper mapper = new objectmapper(); objectnode nodes = mapper.readvalue(new file("d:\\test.txt"), objectnode.class); nodes.with("addressdetails").put("pincode", "414141"); mapper.writer().writevalue(new file("d:\\test.txt"), nodes);
Read more