1

The checkpoint path of flink is an hdfs absolute path like hdfs://address:port/path, but when hdfs is on HA mode, how to set the flink configuration for hdfs namenode url change?

SCouto
  • 7,808
  • 5
  • 32
  • 49
lzh
  • 83
  • 8

1 Answers1

0

Using Hadoop HA ,clusterId is recommended.After doing so,the URI looks like this hdfs://nameservice_id/path/file.Use this URI instead of 'hdfs://activeNamenodeHost/path'.Hope this helps.

How to set here : NameNode HA when using hdfs:// URI.

More details here : https://hadoop.apache.org/docs/r2.7.0/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html

moyiguke
  • 70
  • 1
  • 10