failed to launch: nice -n 0 $HADOOP_HOME/bin/spark-class org.apache.spark.deploy.worker.Worker
完整報錯如下 :
Laptop: failed to launch: nice -n 0 /home/appleyuchi/bigdata/spark-3.0.0-preview2-bin-hadoop3.2/bin/spark-class org.apache.spark.deploy.worker.Worker --webui-port 8081 spark://Desktop:7077
Laptop: ? ?? ?at io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:985)
Laptop: ? ?? ?at io.netty.channel.AbstractChannel.bind(AbstractChannel.java:247)
Laptop: ? ?? ?at io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:344)
Laptop: ? ?? ?at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163)
Laptop: ? ?? ?at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:510)
Laptop: ? ?? ?at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:518)
Laptop: ? ?? ?at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
Laptop: ? ?? ?at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
Laptop: ? ?? ?at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
Laptop: ? ?? ?at java.lang.Thread.run(Thread.java:748)
Laptop: full log in /home/appleyuchi/bigdata/spark-3.0.0-preview2-bin-hadoop3.2/logs/spark-appleyuchi-org.apache.spark.deploy.worker.Worker-1-Laptop.out
starting org.apache.spark.deploy.history.HistoryServer, logging to /home/appleyuchi/bigdata/spark-3.0.0-preview2-bin-hadoop3.2/logs/spark-appleyuchi-org.apache.spark.deploy.history.HistoryServer-1-Desktop.out
?
原因:
我們直接把master的配置復制給了slave
解決方案:
將slave機器的spark-env.sh文件設置如下
export SPARK_LOCAL_IP=Laptop(你的slave域名或者slave的ip)
此處也可以是0.0.0.0,根據自己喜好設置即可
?
?
?
?
總結
以上是生活随笔為你收集整理的failed to launch: nice -n 0 $HADOOP_HOME/bin/spark-class org.apache.spark.deploy.worker.Worker的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: 转转app怎么卖东西(转转二手官方验)
- 下一篇: spark和hadoop升级记录(持续更