HDFS Commands, HDFS Permissions and HDFS Storage

This chapter is from the book

Expert Hadoop Administration: Managing, Tuning, and Securing Spark, YARN, and HDFS

Learn More Buy

This chapter is from the book

This chapter is from the book 

Expert Hadoop Administration: Managing, Tuning, and Securing Spark, YARN, and HDFS

Learn More Buy

Summary

Here’s what you learned in this chapter:

• The hdfs dfs command is your ally in performing day-to-day work with HDFS files and directories

• The hdfs dfsadmin command is highly useful for checking the status of the DataNodes and the way HDFS data is spread across the DataNodes

• By granting space and file quotas, you can control HDFS usage.

• RThe hdfs du and hdfs df commands are handy for finding out how your cluster is using its storage

• Balancing your cluster’s data on a regular basis provides computational benefits by evenly spreading HDFS data across all the nodes of your Hadoop cluster.