Spark-env.sh # Options for the daemons used in the standalone deploy mode Part of the file with SPARK_MASTER_HOST addition is shown below: Make a copy of spark-env.sh.template with name spark-env.sh and add/edit the field SPARK_MASTER_HOST. Note : If spark-env.sh is not present, spark-env.sh.template would be present. Edit the file spark-env.sh – Set SPARK_MASTER_HOST. SPARK_HOME is the complete path to root directory of Apache Spark in your computer.Ģ. Navigate to Spark Configuration Directory. Execute the following steps on the node, which you want to be a Master.ġ. To Setup an Apache Spark Cluster, we need to know two things :įollowing is a step by step guide to setup Master node for an Apache Spark cluster.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |