MapR provides an express path (called ExpressLane) that works in conjunction with the Fair Scheduler. ExpressLane is for small MapReduce jobs to run when all slots are occupied by long tasks. Small jobs are only given this special treatment when the cluster is busy, and only if they meet the criteria specified by the following parameters in
Enable small job fast scheduling inside fair scheduler. TaskTrackers should reserve a slot called ephemeral slot, which is used for
smalljob if the cluster is busy.
Small job definition. Max number of maps allowed in small job.
Small job definition. Max number of reducers allowed in small job.
Small job definition. Max input size in bytes allowed for a small job. Default is 10GB.
Small job definition. Max estimated input size for a reducer allowed in small job. Default is 1GB per reducer.
Small job definition. Max memory in mbytes reserved for an ephermal slot. Default is 200mb. This value must be same on JobTracker and TaskTracker nodes.
MapReduce jobs that appear to fit the small job definition but are in fact larger than anticipated are killed and re-queued for normal execution.