Java gateway process exited before sending its port number

window系统用阿里云安装好pyspark之后执行from pyspark.sql import SparkSessionspark = SparkSession \.builder \.appName("my_first_app_spark") \.getOrCreate()报错如下Exception: Java gateway process exited before sending it

hejp_123

6095人浏览 · 2020-06-16 12:43:27

hejp_123 · 2020-06-16 12:43:27 发布

window系统用阿里云安装好pyspark之后执行


from pyspark.sql import SparkSession
 
spark = SparkSession \
    .builder \
    .appName("my_first_app_spark") \
    .getOrCreate()

报错如下

Exception: Java gateway process exited before sending its port number

解决方法：找到java的安装目录

在脚本中输入：

import os
os.environ['JAVA_HOME'] = 'C:\Program Files\Java\jdk1.8.0_251' # 这个路径更换为你自己的java安装目录

问题解决，大功告成。

完整代码为

import os
os.environ['JAVA_HOME'] = 'C:\Program Files\Java\jdk1.8.0_251'
from pyspark.sql import SparkSession
spark = SparkSession \
    .builder \
    .appName("my_app_spark") \
    .getOrCreate()
 
spark.sql("select 1").show()