已经解决ProcfsMetricsGetter: Exception when trying to compute pagesize_13742370

网络 02-07 7250

已解决ProcfsMetricsGetter: Exception when trying to compute pagesize, as a result reporting of ProcessTree metrics is stopped

已解决ProcfsMetricsGetter问题！

按照流程安装了JDP、scala、hadoop和spark后，运行spark-shell。出现以下情况。

C:\Users\菜鸟新人的姓名>spark-shell Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties Spark context Web UI available at http://LAPTOP-TPAT0U8U:4040 Spark context available as 'sc' (master = local[*], app id = local-1595427757812). Spark session available as 'spark'. Welcome to ____ __ / __/__ ___ _____/ /__ _\ \/ _ \/ _ `/ __/ '_/ /___/ .__/\_,_/_/ /_/\_\ version 3.0.0 /_/ Using Scala version 2.12.10 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_261) Type in expressions to have them evaluated. Type :help for more information. scala> 20/07/22 22:22:52 WARN ProcfsMetricsGetter: Exception when trying to compute pagesize, as a result reporting of ProcessTree metrics is stopped

把spark-3.0.0-bin-hadoop2.7换成了spark-2.4.6-bin-hadoop2.7，再修改一下相应的环境变量路径。就不报错了。该方法来自：https://·/article/75441509786/

C:\Users\菜鸟新人的名字>spark-shell Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 20/07/24 10:23:00 WARN Utils: Service 'SparkUI' could not bind on port 4040. Attempting port 4041. Spark context Web UI available at http://LAPTOP-TPAT0U8U:4041 Spark context available as 'sc' (master = local[*], app id = local-1595557380531). Spark session available as 'spark'. Welcome to ____ __ / __/__ ___ _____/ /__ _\ \/ _ \/ _ `/ __/ '_/ /___/ .__/\_,_/_/ /_/\_\ version 2.4.6 /_/ Using Scala version 2.11.12 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_261) Type in expressions to have them evaluated. Type :help for more information. scala> print("hello spark world") hello spark world scala> spark.createDataset(Seq("hello,world")).show +-----------+ | value| +-----------+ |hello,world| +-----------+