HDFS

hadoop 3.0 alpha documentation
https://hadoop.apache.org/docs/current/index.html

hadoop commands
https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/CommandsManual.html

hadoop file system commands
https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/FileSystemShell.html

HDFS high availability
https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html
Quorum Journal Manager (QJM)
Check point validation
Active and Standby NameNodes
NameNode machines Vs JournalNode machines

Notes:
Copy files using Python
http://stackoverflow.com/questions/10380496/copying-file-to-hdfs-using-pydoop
Write files to HDFS using python
http://stackoverflow.com/questions/26606128/how-to-save-a-file-in-hadoop-with-python

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s