文章目录 一、安装kafka二、spark安装kakfa依赖库

---

一、安装kafka

官方下载地址: https://kafka.apache.org/downloads

$cd ~/下载 sudo tar -zxf kafka_2.11-0.10.1.0.tgz -C /usr/local cd /usr/local sudo mv kafka_2.11-0.10.1.0/ ./kafka sudo chown -R hadoop ./kafka 二、spark安装kakfa依赖库

下载.jar包地址 https://mvnrepository.com/ https://search.maven.org/

下载spark-streaming-kafka-0-10_2.11-2.3.0.jar 后，配置相关环境 cd /usr/local/spark/jars mkdir kafka cd ~/下载 cp ./spark-streaming-kafka-0-8_2.11-2.4.0.jar /usr/local/spark/jars/kafka cd /usr/local/kafka/libs ls cp ./* /usr/local/spark/jars/kafka cd /usr/local/spark/conf vim spark-env.sh export SPARK_DIST_CLASSPATH= ( / u s r / l o c a l / h a d o o p / b i n / h a d o o p c l a s s p a t h ) : (/usr/local/hadoop/bin/hadoop classpath): (/usr/local/hadoop/bin/hadoopclasspath):(/usr/local/hbase/bin/hbase classpath):/usr/local/spark/jars/hbase/:/usr/local/spark/examples/jars/:/usr/local/spark/jars/kafka/:/usr/local/kafka/libs/

---

1.本站遵循行业规范，任何转载的稿件都会明确标注作者和来源；2.本站的原创文章，会注明原创字样,如未注明都非原创，如有侵权请联系删除！；3.作者投稿可能会经我们编辑修改或补充；4.本站不提供任何储存功能只提供收集或者投稿人的网盘链接。