Monitoring Hadoop with Prometheus JMX

Question

I want to export my Hadoop JMX metrics to prometheus for Monitoring so i have done the following changes: Register a prometheus JMX exporter by adding following lines to hadoop-env.sh

export HADOOP_NAMENODE_OPTS

="${HADOOP_NAMENODE_OPTS} -javaagent:/usr/local/hive/hadoop/etc/hadoop/jmx_prometheus_javaagent-0.11.0.jar=19850:/usr/local/hive/hadoop/etc/hadoop/namenode.yml"

Restarted the server using:

./stop-dfs.sh
./stop-yarn.sh

On starting ./start-dfs.sh i am getting below error:

WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
Starting namenodes on [localhost]
localhost: ERROR: Cannot set priority of namenode process 20930
Starting datanodes
Starting secondary namenodes [my-worker]

Comments

Hey, @Som,

Just check is your Datanode working fine?

Answer 1

Hi@Som,

This error is not related to Prometheus I guess. First, check the environment variables in the .bashrc file. Also, check the logs of master node. You will get the exact problem. If you are facing a problem to troubleshoot the error, then paste the error here.