Hi guys, I followed the steps of this blog (https://nebula-graph.io/posts/nebula-spark-connector-reader/ ) to build the JAR, but a got an error when built it, something with package com.vesoft.nebula.shaded.google.common.base went wrong,
nicole
17 January 2021 06:49
2
Sorry that the blog need to be update.
cd nebula-java
mvn clean compile package install -Dgpg.skip -Dmaven.javadoc.skip=true
Hi Nicole, thanks for your reply.
Just to confirm, I’m working under the branch v1.0.
Thanks
nicole
18 January 2021 01:25
4
When compile nebula-java in non-linux system， you should skip all the test using:
I tried and got another error when nebula-spark is building.
nicole
18 January 2021 09:30
6
Maybe your Scala version or Spark version is not compatible, please check the Scala version and Spark version. And what’s your JDK version?
Scala version used in nebula-spark is 2.11.
nicole
18 January 2021 09:47
7
This issue is familiar with the compile problem:
opened 09:44PM - 14 Dec 18 UTC
closed 11:15PM - 05 Jan 19 UTC
**System**
Windows 10.0.17134
`xgboost.dll` successfully compiled with MSVC Co… mpiler.
**Log**
```java
building Java wrapper
cd ..
mkdir -p build
cd build
cmake .. -DUSE_OPENMP:BOOL=ON -DUSE_HDFS:BOOL=OFF -DUSE_AZURE:BOOL=OFF -DUSE_S3:BOOL=OFF -DPLUGIN_UPDATER_GPU:BOOL=OFF -DJVM_BINDINGS:BOOL=ON -G"Visual Studio 15 2017 Win64"
cmake --build . --config Release
cd demo\regression
C:\Users\shiva\AppData\Local\Programs\Python\Python36-32\python.exe mapfeat.py
C:\Users\shiva\AppData\Local\Programs\Python\Python36-32\python.exe mknfold.py machine.txt 1
copying native library
mkdir -p xgboost4j\src\main\resources\lib
cp ..\lib\xgboost4j.dll xgboost4j\src\main\resources\lib
copying pure-Python tracker
cp ..\dmlc-core\tracker\dmlc_tracker\tracker.py xgboost4j\src\main\resources
copying train/test files
mkdir -p xgboost4j-spark\src\test\resources
cd ..\demo\regression
C:\Users\shiva\AppData\Local\Programs\Python\Python36-32\python.exe mapfeat.py
C:\Users\shiva\AppData\Local\Programs\Python\Python36-32\python.exe mknfold.py machine.txt 1
cp ..\demo\regression\machine.txt.test xgboost4j-spark\src\test\resources
cp ..\demo\regression\machine.txt.train xgboost4j-spark\src\test\resources
cp ..\demo\data\agaricus.txt.test xgboost4j-spark\src\test\resources
cp ..\demo\data\agaricus.txt.train xgboost4j-spark\src\test\resources
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ xgboost4j ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.2:compile (default) @ xgboost4j ---
[WARNING] Expected all dependencies to require Scala version: 2.11.12
[WARNING] com.typesafe.akka:akka-actor_2.11:2.3.11 requires scala version: 2.11.5
[WARNING] Multiple versions of scala libraries detected!
[INFO] C:\Program Files\xgboost\jvm-packages\xgboost4j\src\main\java:-1: info: compiling
[INFO] C:\Program Files\xgboost\jvm-packages\xgboost4j\src\main\scala:-1: info: compiling
[INFO] Compiling 24 source files to C:\Program Files\xgboost\jvm-packages\xgboost4j\target\classes at 1544818940529
Downloading from central_maven: https://repo1.maven.org/maven2/org/scala-lang/scala-library/2.11.7/scala-library-2.11.7.jar
Downloaded from central_maven: https://repo1.maven.org/maven2/org/scala-lang/scala-library/2.11.7/scala-library-2.11.7.jar (5.7 MB at 593 kB/s)
[ERROR] error: java.lang.NoClassDefFoundError: javax/tools/ToolProvider
[INFO] at scala.reflect.io.JavaToolsPlatformArchive.iterator(ZipArchive.scala:301)
[INFO] at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
[INFO] at scala.reflect.io.AbstractFile.foreach(AbstractFile.scala:92)
[INFO] at scala.tools.nsc.util.DirectoryClassPath.traverse(ClassPath.scala:277)
[INFO] at scala.tools.nsc.util.DirectoryClassPath.x$15$lzycompute(ClassPath.scala:299)
[INFO] at scala.tools.nsc.util.DirectoryClassPath.x$15(ClassPath.scala:299)
[INFO] at scala.tools.nsc.util.DirectoryClassPath.packages$lzycompute(ClassPath.scala:299)
[INFO] at scala.tools.nsc.util.DirectoryClassPath.packages(ClassPath.scala:299)
[INFO] at scala.tools.nsc.util.DirectoryClassPath.packages(ClassPath.scala:264)
[INFO] at scala.tools.nsc.util.MergedClassPath$$anonfun$packages$1.apply(ClassPath.scala:358)
[INFO] at scala.tools.nsc.util.MergedClassPath$$anonfun$packages$1.apply(ClassPath.scala:358)
[INFO] at scala.collection.Iterator$class.foreach(Iterator.scala:891)
[INFO] at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
[INFO] at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
[INFO] at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
[INFO] at scala.tools.nsc.util.MergedClassPath.packages$lzycompute(ClassPath.scala:358)
[INFO] at scala.tools.nsc.util.MergedClassPath.packages(ClassPath.scala:353)
[INFO] at scala.tools.nsc.symtab.SymbolLoaders$PackageLoader$$anonfun$doComplete$1.apply$mcV$sp(SymbolLoaders.scala:269)
[INFO] at scala.tools.nsc.symtab.SymbolLoaders$PackageLoader$$anonfun$doComplete$1.apply(SymbolLoaders.scala:260)
[INFO] at scala.tools.nsc.symtab.SymbolLoaders$PackageLoader$$anonfun$doComplete$1.apply(SymbolLoaders.scala:260)
[INFO] at scala.reflect.internal.SymbolTable.enteringPhase(SymbolTable.scala:235)
[INFO] at scala.tools.nsc.symtab.SymbolLoaders$PackageLoader.doComplete(SymbolLoaders.scala:260)
[INFO] at scala.tools.nsc.symtab.SymbolLoaders$SymbolLoader.complete(SymbolLoaders.scala:211)
[INFO] at scala.reflect.internal.Symbols$Symbol.info(Symbols.scala:1535)
[INFO] at scala.reflect.internal.Mirrors$RootsBase.init(Mirrors.scala:256)
[INFO] at scala.tools.nsc.Global.rootMirror$lzycompute(Global.scala:73)
[INFO] at scala.tools.nsc.Global.rootMirror(Global.scala:71)
[INFO] at scala.tools.nsc.Global.rootMirror(Global.scala:39)
[INFO] at scala.reflect.internal.Definitions$DefinitionsClass.ObjectClass$lzycompute(Definitions.scala:257)
[INFO] at scala.reflect.internal.Definitions$DefinitionsClass.ObjectClass(Definitions.scala:257)
[INFO] at scala.reflect.internal.Definitions$DefinitionsClass.init(Definitions.scala:1390)
[INFO] at scala.tools.nsc.Global$Run.<init>(Global.scala:1242)
[INFO] at scala.tools.nsc.Driver.doCompile(Driver.scala:31)
[INFO] at scala.tools.nsc.MainClass.doCompile(Main.scala:23)
[INFO] at scala.tools.nsc.Driver.process(Driver.scala:51)
[INFO] at scala.tools.nsc.Driver.main(Driver.scala:64)
[INFO] at scala.tools.nsc.Main.main(Main.scala)
[INFO] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[INFO] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[INFO] at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[INFO] at java.base/java.lang.reflect.Method.invoke(Method.java:566)
[INFO] at scala_maven_executions.MainHelper.runMain(MainHelper.java:164)
[INFO] at scala_maven_executions.MainWithArgsInFile.main(MainWithArgsInFile.java:26)
[INFO] java.lang.reflect.InvocationTargetException
[INFO] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[INFO] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[INFO] at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[INFO] at java.base/java.lang.reflect.Method.invoke(Method.java:566)
[INFO] at scala_maven_executions.MainHelper.runMain(MainHelper.java:164)
[INFO] at scala_maven_executions.MainWithArgsInFile.main(MainWithArgsInFile.java:26)
[ERROR] Caused by: java.lang.NoClassDefFoundError: javax/tools/ToolProvider
[INFO] at scala.reflect.io.JavaToolsPlatformArchive.iterator(ZipArchive.scala:301)
[INFO] at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
[INFO] at scala.reflect.io.AbstractFile.foreach(AbstractFile.scala:92)
[INFO] at scala.tools.nsc.util.DirectoryClassPath.traverse(ClassPath.scala:277)
[INFO] at scala.tools.nsc.util.DirectoryClassPath.x$15$lzycompute(ClassPath.scala:299)
[INFO] at scala.tools.nsc.util.DirectoryClassPath.x$15(ClassPath.scala:299)
[INFO] at scala.tools.nsc.util.DirectoryClassPath.packages$lzycompute(ClassPath.scala:299)
[INFO] at scala.tools.nsc.util.DirectoryClassPath.packages(ClassPath.scala:299)
[INFO] at scala.tools.nsc.util.DirectoryClassPath.packages(ClassPath.scala:264)
[INFO] at scala.tools.nsc.util.MergedClassPath$$anonfun$packages$1.apply(ClassPath.scala:358)
[INFO] at scala.tools.nsc.util.MergedClassPath$$anonfun$packages$1.apply(ClassPath.scala:358)
[INFO] at scala.collection.Iterator$class.foreach(Iterator.scala:891)
[INFO] at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
[INFO] at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
[INFO] at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
[INFO] at scala.tools.nsc.util.MergedClassPath.packages$lzycompute(ClassPath.scala:358)
[INFO] at scala.tools.nsc.util.MergedClassPath.packages(ClassPath.scala:353)
[INFO] at scala.tools.nsc.symtab.SymbolLoaders$PackageLoader$$anonfun$doComplete$1.apply$mcV$sp(SymbolLoaders.scala:269)
[INFO] at scala.tools.nsc.symtab.SymbolLoaders$PackageLoader$$anonfun$doComplete$1.apply(SymbolLoaders.scala:260)
[INFO] at scala.tools.nsc.symtab.SymbolLoaders$PackageLoader$$anonfun$doComplete$1.apply(SymbolLoaders.scala:260)
[INFO] at scala.reflect.internal.SymbolTable.enteringPhase(SymbolTable.scala:235)
[INFO] at scala.tools.nsc.symtab.SymbolLoaders$PackageLoader.doComplete(SymbolLoaders.scala:260)
[INFO] at scala.tools.nsc.symtab.SymbolLoaders$SymbolLoader.complete(SymbolLoaders.scala:211)
[INFO] at scala.reflect.internal.Symbols$Symbol.info(Symbols.scala:1535)
[INFO] at scala.reflect.internal.Mirrors$RootsBase.init(Mirrors.scala:256)
[INFO] at scala.tools.nsc.Global.rootMirror$lzycompute(Global.scala:73)
[INFO] at scala.tools.nsc.Global.rootMirror(Global.scala:71)
[INFO] at scala.tools.nsc.Global.rootMirror(Global.scala:39)
[INFO] at scala.reflect.internal.Definitions$DefinitionsClass.ObjectClass$lzycompute(Definitions.scala:257)
[INFO] at scala.reflect.internal.Definitions$DefinitionsClass.ObjectClass(Definitions.scala:257)
[INFO] at scala.reflect.internal.Definitions$DefinitionsClass.init(Definitions.scala:1390)
[INFO] at scala.tools.nsc.Global$Run.<init>(Global.scala:1242)
[INFO] at scala.tools.nsc.Driver.doCompile(Driver.scala:31)
[INFO] at scala.tools.nsc.MainClass.doCompile(Main.scala:23)
[INFO] at scala.tools.nsc.Driver.process(Driver.scala:51)
[INFO] at scala.tools.nsc.Driver.main(Driver.scala:64)
[INFO] at scala.tools.nsc.Main.main(Main.scala)
[INFO] ... 6 more
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for XGBoost JVM Package 0.82-SNAPSHOT:
[INFO]
[INFO] XGBoost JVM Package ................................ SUCCESS [ 38.418 s]
[INFO] xgboost4j .......................................... FAILURE [21:57 min]
[INFO] xgboost4j-spark .................................... SKIPPED
[INFO] xgboost4j-flink .................................... SKIPPED
[INFO] xgboost4j-example .................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 22:36 min
[INFO] Finished at: 2018-12-15T01:52:43+05:30
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile (default) on project xgboost4j: wrap: org.apache.commons.exec.ExecuteException: Process exited with an error: -10000 (Exit value: -10000) -> [Help 1]
```
**Reproduce with**
```
xgboost\build> cmake .. -G"Visual Studio 15 2017 Win64" -DUSE_CUDA=ON -DUSE_OPENMP=ON; cd ..\jvm-packages\
xgboost\jvm-packages> mvn -DskipTests clean package install
```
The default maybe_generator in `create_jni.py` (line 83 for me) has been changed to the required version, `-G"Visual Studio 15 2017 Win64"` before proceeding with the maven install command. Successful completion before "Building Java Wrapper" has been omitted.
It built using jdk 8 and maven 3.6.3.
Thanks for your support Nicole.
