Is there any difference between hdfs dfs and hadoop fs shell commands

Question

Are both means the same? but, why the "hdfs dfs" commands show the local files while the "hadoop fs" commands show the hdfs files?

Answer 1

hadoop fs <args>

fs is used for generic file system and it can point to any file system such as local file system, HDFS, WebHDFS, S3 FS, etc.

hadoop dfs <args>

hdfs dfs <args>

dfs points to the Distributed File System and it is specific to HDFS. You can use it to execute operations on HDFS. Now it is deprecated, and you have to use hdfs dfs instead of hadoop dfs. 

Learn more about Big Data Architect and its concepts from the Data architecture course.

Answer 2

fs refers to any file system, it could be local or HDFS but dfs refers to only HDFS file system.

So if you need to perform access/transfer data between different filesystem, fs is the way to go

Answer 3

Both of them are same. They are just different syntax of commands for different versions.

Comments

They are similar but they are not the same. fs is file system and it could be the normal file system. dfs is distributed file system. 

---

Oh. I did not know that. Thanks

Answer 4

hdfs points to only hadoop file system whereas hadoop fs points to either local or hadoop file system

Answer 5

dfs means ditributed file system and fs means file system. Here, fs include local file system and hdfs

Answer 6

Here's a definition for both these command:

elif [ "$COMMAND" = "fs" ] ; then
  CLASS=org.apache.hadoop.fs.FsShell
  HADOOP_OPTS="$HADOOP_OPTS $HADOOP_CLIENT_OPTS"
elif [ "$COMMAND" = "dfs" ] ; then
  CLASS=org.apache.hadoop.fs.FsShell

Answer 7

You can find the definition of these commands and hence the difference in the hadoop file. Path:

$HADOOP_HOME/bin/hadoop

Answer 8

hdfs dfs can be considered a subset of hadoop fs because hadoop fs includes hdfs along with different sile system

Answer 9

Hadoop fs contains different file systems like hdfs, local file system, web hdfs etc. And dfs is only distributed file system.

Answer 10

Yes, there's a difference between hadoop fs and hdfs dfs. hadoop fs is used to communicate with any file system. hdfs dfs is used to communicate particularly with hadoop distributed file system.