Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12615 Router-based HDFS federation phase 2
  3. HDFS-13099

RBF: Use the ZooKeeper as the default State Store

    XMLWordPrintableJSON

Details

    • Incompatible change, Reviewed
    • Change default State Store from local file to ZooKeeper. This will require additional zk address to be configured.

    Description

      Currently the State Store Driver relevant settings only written in its implement classes.

      public class StateStoreZooKeeperImpl extends StateStoreSerializableImpl {
      ...
      
        /** Configuration keys. */
        public static final String FEDERATION_STORE_ZK_DRIVER_PREFIX =
            DFSConfigKeys.FEDERATION_STORE_PREFIX + "driver.zk.";
        public static final String FEDERATION_STORE_ZK_PARENT_PATH =
            FEDERATION_STORE_ZK_DRIVER_PREFIX + "parent-path";
        public static final String FEDERATION_STORE_ZK_PARENT_PATH_DEFAULT =
            "/hdfs-federation";
      ..
      

      Actually, they should be moved into class DFSConfigKeys and documented in file hdfs-default.xml. This will help more users know these settings and know how to use.

      Attachments

        1. HDFS-13099.001.patch
          2 kB
          Yiqun Lin
        2. HDFS-13099.002.patch
          1 kB
          Yiqun Lin
        3. HDFS-13099.003.patch
          4 kB
          Yiqun Lin
        4. HDFS-13099.004.patch
          7 kB
          Yiqun Lin
        5. HDFS-13099.005.patch
          9 kB
          Yiqun Lin
        6. HDFS-13099.006.patch
          8 kB
          Yiqun Lin

        Activity

          People

            linyiqun Yiqun Lin
            linyiqun Yiqun Lin
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: