Home >> Big Data Hadoop >> Scheduler in Big Data Hadoop

Scheduler in Big Data Hadoop

Fair scheduler:

i) jobs to make equal progress instead of following the FIFO order then  must use Fair Scheduling.

ii) If slow connectivity and data locality plays a vital role and makes a significant difference to the job runtime then  must use Fair Scheduling.

iii) if there is lot of variability in the utilization between pools.

Capacity scheduler:

i) If the jobs require scheduler detrminism then Capacity Scheduler can be useful.

ii) CS's memory based scheduling method is useful if the jobs have varying memory requirements.

iii) want to enforce resource allocation  because you know very well about the cluster utilization and workload then use Capacity Scheduler.

Post Your Comment

Next Questions
Distcp
HistoryServer
Pig Prerequisites
Pig Installation
Pig Topics
What is Pig?
Pig Architecture
Pig Mode
Pig Load data from HDFS
Pig Store data into HDFS
Pig Load and Store
Pig Features
Pig Vs MapReduce
Pig Vs Hive
Data Model(Data Types)
Pig Tuple
Pig Bag
Pig Map
Pig Data types
Pig Complex types
Pig Relational Operations
Pig Shell Commands
Pig Register jar
Pig Diagnostic Operators
Pig Group Operator

Copyright ©2022 coderraj.com. All Rights Reserved.