Where to set hadoop tmp dir core-site xml or hdfs-site xml

714    Asked by AudreyBerry in Salesforce , Asked on Jul 19, 2021

While searching on Internet I found that somewhere it is mentioned that hadoop.tmp.dir be set in hdfs-site.xml and somewhere it is mentioned to specify it in core-site.xml. Which is the right place to put it?

Answered by Benjamin Moore

hadoop.tmp.dir (A base for other temporary directories) is property, that need to be set in core-site.xml

Ex:  dfs.namenode.name.dir

  file://${hadoop.tmp.dir}/dfs/name

You can use reference of hadoop.tmp.dir in hdfs-site.xml like above For more core-site.xml and hdfs-site.xml There're three HDFS properties which contain hadoop.tmp.dir in their values dfs.name.dir: directory where namenode stores its metadata, with default value ${hadoop.tmp.dir}/dfs/name. dfs.data.dir: directory where HDFS data blocks are stored, with default value ${hadoop.tmp.dir}/dfs/data. fs.checkpoint.dir: directory where secondary namenode store its checkpoints, default value is${hadoop.tmp.dir}/dfs/namesecondary



Your Answer

Interviews

Parent Categories