java - Too much dependecies into jar with maven -


i packaging spark project 1 jar file when compile maven includes lot jars (100mb, size!!) not org/log4j/* dependencies (it generates error in execution time), adds others jboss/netty/* jar.

i suppose dependencies included each other, must assume 100 mb ¿?, not include dependencies org/log4j/*

¿are there way include 10 jars specified maven xml file? :

 <dependencies>       <dependency>           <groupid>junit</groupid>           <artifactid>junit</artifactid>           <version>4.12</version>           <scope>test</scope>       </dependency>       <dependency>           <groupid>log4j</groupid>           <artifactid>log4j</artifactid>           <version>1.2.17</version>     </dependency>       <dependency>           <groupid>org.apache.commons</groupid>           <artifactid>commons-io</artifactid>           <version>1.3.2</version>       </dependency>       <dependency>           <groupid>org.apache.commons</groupid>           <artifactid>commons-lang3</artifactid>           <version>3.5</version>     </dependency>     <dependency>       <groupid>commons-codec</groupid>       <artifactid>commons-codec</artifactid>       <version>1.9</version>     </dependency>       <dependency>           <groupid>com.google.code.gson</groupid>           <artifactid>gson</artifactid>           <version>2.6.2</version>       </dependency>       <dependency>           <groupid>org.json</groupid>           <artifactid>json</artifactid>           <version>20170516</version>       </dependency>       <dependency>           <groupid>org.apache.hadoop</groupid>           <artifactid>hadoop-common</artifactid>           <version>2.8.1</version>       </dependency>       <dependency>           <groupid>org.apache.spark</groupid>           <artifactid>spark-sql_2.10</artifactid>           <version>${spark.version}</version>       </dependency>       <dependency>           <groupid>org.apache.spark</groupid>           <artifactid>spark-core_2.10</artifactid>           <version>${spark.version}</version>       </dependency>       <dependency>           <groupid>com.databricks</groupid>           <artifactid>spark-csv_2.10</artifactid>           <version>${spark.version}</version>       </dependency>   </dependencies>

to create 'jar-with-dependencies' use plugins:

   <plugin>                 <artifactid>maven-dependency-plugin</artifactid>                 <executions>                     <execution>                         <phase>process-sources</phase>                         <goals>                             <goal>copy-dependencies</goal>                         </goals>                         <configuration>                             <outputdirectory>${targetdirectory}</outputdirectory>                         </configuration>                     </execution>                 </executions>             </plugin>             <plugin>                 <artifactid>maven-assembly-plugin</artifactid>                 <version>2.6</version>                 <configuration>                     <descriptorrefs>                         <descriptorref>jar-with-dependencies</descriptorref>                     </descriptorrefs>                 </configuration>                 <executions>                     <execution>                         <phase>package</phase>                         <goals>                             <goal>single</goal>                         </goals>                     </execution>                 </executions>             </plugin>

thanks

there dependency tree, i.e. dependencies pulling in own dependencies , on.

to show tree use 

mvn dependency:tree

see https://maven.apache.org/plugins/maven-dependency-plugin/tree-mojo.html


Comments

Post a Comment

Popular posts from this blog

php - Vagrant up error - Uncaught Reflection Exception: Class DOMDocument does not exist -

i've set bento/ubuntu-16.04 vagrant box using php 5.6, , getting following error quite few times when try , run shell script: "uncaught reflection exception: class domdocument not exist". i've tried adding following top of script (not together), each no success: "sudo apt-get install php5.6-xml", "sudo apt-get install php5-xml", "sudo apt-get install php-dom" i've tried resetting server "sudo service apache2 restart". does have suggestions?
Read more

vue.js - Create hooks for automated testing -

Image
qa guys complained can't automate frontend testing. because our html looks same outside. lazy hack did this <template> <div :role="$options.name"> ... </div> </template> <script> export default { name: 'vmcomponentname' } </script> which takes name script , applies html. in browser get: <div role="vmcomponentname"> ... </div> line :role="$options.name" goes in every component. is there dry er solutions? please share. additional details i'll explain in details looking for. imagine have vmusercreate form creates user. test case can create user . to automatically test without role, have use following selector: .wrapper > .wrapper > .wrapper > .submit-button the test extremely brittle (will break lot). if use roles can use [role="vmusercreateform"] .submit-button selector. many folds less brittle. so basically, i'm ...
Read more

Add new key value to json node in java -

i have json file : { "id":1, "name":"abc", "addressdetails": { "city":"newyork" } } i wanted add 1 more key-value ("pincode" : "414141") node 'addressdetails'. i tried using : objectmapper mapper = new objectmapper(); jsonnode root = mapper.readtree(new file("d://test.json")); objectnode node = mapper.createobjectnode(); node.with("addressdetails").put("pincode", "414141"); but it's not getting added, there way can ? you can try you should modify file path objectmapper mapper = new objectmapper(); objectnode nodes = mapper.readvalue(new file("d:\\test.txt"), objectnode.class); nodes.with("addressdetails").put("pincode", "414141"); mapper.writer().writevalue(new file("d:\\test.txt"), nodes);
Read more