鍍金池/ 教程/ 大數(shù)據(jù)/ Hadoop 測試
YARN - Failover
MapReduce - Shuffle
Hadoop配置
MapReduce - 讀取數(shù)據(jù)
Hadoop - MapReduce
YARN - Container
Hadoop 測試
MapReduce - Mapper
Hadoop - 參考
YARN - ResourceManager
HDFS - 可靠性
HDFS - 讀文件
Hadoop - 簡介
YARN - ApplicationMaster
Hadoop - IO
Hadoop 監(jiān)控
MapReduce - 編程
Hadoop - YARN
Hadoop - HDFS
HDFS - 命令工具
HDFS - 寫文件
YARN - NodeManager
Hadoop安裝

Hadoop 測試

MRUnit單元測試Mapper和Reducer類在內(nèi)存上獨(dú)立運(yùn)行, PipelineMapReduceDriver單線程運(yùn)行.

LocalJobRunner單線程運(yùn)行, 且僅有一個 Reducer能夠啟動conf.set("mapred.job.tracker", "local"); conf.set("fs.default.name", "file:////&ququot;); FileSystem fs = FileSystem.getLocal(conf);

MiniMRCluster, MiniYarnCluster, MiniDFSCluster 多線程

上一篇:YARN - NodeManager下一篇:Hadoop - YARN