Hadoop Big Data Summary

1. Ubuntu Server 16.04 LTS (HVM), SSD Volume Type
2. Java(TM) SE Runtime Environment (build 1.8.0_151-b12)
3. Hadoop 2.8.2
4. Pig-0.17.0-src.tar.gz
5. Hive 

/opt/hadoop-2.8.2/etc/Hadoop/* 

HDFS

├── core-site.xml

├── hadoop-env.sh

├── hdfs-site.xml

MapReduce 程式(Pig, hive代替)

├── mapred-env.sh

├── mapred-site.xml

YARN 分散運算

├── yarn-env.sh

└── yarn-site.xml


MapReduce