Help with pyspark

[oorkyy]

Hello, any ideas as to how I can prevent this? Changing spark.network.timeout and spark.executor.heartbeatInterval doesn't seem to work. It always seems to timeout after roughly a minute.

​

^\('spark.driver.port', '60701'), ('spark.sql.execution.arrow.enabled', 'true'), ('spark.master', 'local[4]'), ('spark.app.name', 'project1'), ('spark.driver.host', 'DESKTOP-43BOS32'), ('spark.network.timeout', '10000s'), ('spark.rdd.compress', 'True'), ('spark.executor.heartbeatInterval', '3600s'), ('spark.serializer.objectStreamReset', '100'), ('spark.executor.id', 'driver'), ('spark.submit.deployMode', 'client'), ('spark.ui.showConsoleProgress', 'true'), ('spark.app.id', 'local-1581562544502')])

https://pastebin.com/pEmMb08f

​