Exception in thread “main“ java.lang.AbstractMethodError

迈不过友情╰ 2023-01-11 03:47 191阅读 0赞

Exception in thread "main" java.lang.AbstractMethodError
    	at org.apache.spark.internal.Logging$class.initializeLogIfNecessary(Logging.scala:99)
    	at org.apache.spark.streaming.kafka010.KafkaUtils$.initializeLogIfNecessary(KafkaUtils.scala:40)
    	at org.apache.spark.internal.Logging$class.log(Logging.scala:46)
    	at org.apache.spark.streaming.kafka010.KafkaUtils$.log(KafkaUtils.scala:40)
    	at org.apache.spark.internal.Logging$class.logWarning(Logging.scala:66)
    	at org.apache.spark.streaming.kafka010.KafkaUtils$.logWarning(KafkaUtils.scala:40)
    	at org.apache.spark.streaming.kafka010.KafkaUtils$.fixKafkaParams(KafkaUtils.scala:208)
    	at org.apache.spark.streaming.kafka010.DirectKafkaInputDStream.<init>(DirectKafkaInputDStream.scala:66)
    	at org.apache.spark.streaming.kafka010.KafkaUtils$.createDirectStream(KafkaUtils.scala:150)
    	at org.apache.spark.streaming.kafka010.KafkaUtils$.createDirectStream(KafkaUtils.scala:127)
    	at com.donglin.qzpoint.streaming.QzPointStreaming$.main(QzPointStreaming.scala:70)
    	at com.donglin.qzpoint.streaming.QzPointStreaming.main(QzPointStreaming.scala)
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    	at java.lang.reflect.Method.invoke(Method.java:498)
    	at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
    	at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:845)
    	at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
    	at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
    	at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
    	at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920)
    	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929)
    	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

打包到集群上报错，发现是jar冲突问题，我在集群上spark是2.4.5  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NTQ4ODU1_size_16_color_FFFFFF_t_70]  
**解决方案**  
改对应的版本，重新打包

<dependency>
                <groupId>org.apache.spark</groupId>
                <artifactId>spark-streaming-kafka-0-10_2.11</artifactId>
                <version>2.4.5</version>
            </dependency>

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NTQ4ODU1_size_16_color_FFFFFF_t_70]: /images/20221119/bc5b23d3f3434502ac638df9b1410542.png