Details

    • Hadoop Flags:
      Reviewed

      Description

      Prior to the heterogeneous storage feature, each Datanode had a single storage ID which was generated by the Namenode on first registration. The storage ID used fixed Datanode identifiers like IP address and port, so that in a federated cluster, for example, all NameNodes would generate the same storage ID.

      With Heterogeneous storage, we have replaced the storage ID with a per-datanode identifier called the Datanode-UUID. The Datanode UUID is also assigned by a NameNode on first registration. In a federated cluster with multiple namenodes, there are two ways to ensure a unique Datanode UUID allocation:

      1. Synchronize initial registration requests from the BPServiceActors. If a Datanode UUID is already assigned we don't need to synchronize.
      2. The datanode assigns itself a UUID on initialization.

        Attachments

        1. h5448.04.patch
          4 kB
          Arpit Agarwal
        2. h5448.04.addendum.patch
          0.8 kB
          Arpit Agarwal
        3. h5448.03.patch
          4 kB
          Arpit Agarwal
        4. h5448.01.patch
          3 kB
          Arpit Agarwal

          Activity

            People

            • Assignee:
              arp Arpit Agarwal
              Reporter:
              arp Arpit Agarwal
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: