Eclipse中操作Hive、HDFS、spark时的jar包列表


<img src="https://xiazemin.github.io/MyBlog/img/hivejar.pnghdfsjar"/>

<img src="https://xiazemin.github.io/MyBlog/img/hdfsjar.png"/> 右击“SaprkScala”工程,选择“Properties”,在弹出的框中,按照下图所示,依次选择“Java Build Path” –>“Libraties” –>“Add External JARs…”,导入文章“Apache Spark:将Spark部署到Hadoop 2.2.0上”中给出的 assembly/target/scala-2.9.3/目录下的spark-assembly-0.8.1-incubating- hadoop2.2.0.jar


高版本的在jars 里面



只需要加载所有jars即可



Description Resource Path Location Type
More than one scala library found in the build path (/Users/didi/.p2/pool/plugins/org.scala-lang.scala-library_2.12.3.v20170725-052526-VFINAL-6ac6da8.jar, /Users/didi/spark/spark/jars/scala-library-2.11.8.jar).At least one has an incompatible version. Please update the project build path so it contains only one compatible scala library. online Unknown Scala Classpath Problem



移除
jars/scala-library-2.11.8.jar
即可



Category spark