This is documentation for MapR Version 5.0. You can also refer to MapR documentation for the latest release.

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Install the mapr-nfs and nfs-utils packages if they are not already installed. For reference, see Get Started: Install MapR.
  2. Start the NFS service by using the MapR Control System (MCS) or maprcli (NFS gateway): 

    Code Block
    languagetext
    /opt/mapr/initscripts/mapr-nfsserver start
    /opt/mapr/initscripts/mapr-nfsserver status
  3. Mount NFS to MapR-FS on a cluster node by following the steps in Mounting a Single-Node Cluster Via NFS.
  4. To configure Spark Shuffle on NFS, complete these steps on all nodes:
    1. Create a local volume for Spark Shuffle: 

      Code Block
      languagetext
      sudo -u mapr maprcli volume create -name mapr.$(hostname -f).local.spark -path /var/mapr/local/$(hostname -f)/spark -replication 1 -localvolumehost $(hostname -f)
    2. Point the NodeManager local directory to the Spark Shuffle volume mounted through NFS by setting the following property in the yarn-site.xml file on the NodeManager nodes: 

      Code Block
      languagetext
      <property>
          <name>yarn.nodemanager.local-dirs</name>
          <value>/mapr/my.cluster.com/var/mapr/local/${mapr.host}/spark</value>
      </property>
    3. Restart the NodeManager service (and the Resource Manager service on the main node) to pick up the yarn-site.xml changes: 

      Code Block
      languagetext
      maprcli node services -name nodemanager -action restart -nodes <node 1> <node 2> <node 3>
      maprcli node services -name resourcemanager -action restart

...