Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4465

Optimize datanode ReplicasMap and ReplicaInfo

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.5-alpha
    • Fix Version/s: 2.1.0-beta
    • Component/s: datanode
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      In Hadoop a lot of optimization has been done in namenode data structures to be memory efficient. Similar optimizations are necessary for Datanode process. With the growth in storage per datanode and number of blocks hosted on datanode, this jira intends to optimize long lived ReplicasMap and ReplicaInfo objects.

        Attachments

        1. dn-memory-improvements.patch
          14 kB
          Aaron Myers
        2. HDFS-4465.patch
          13 kB
          Aaron Myers
        3. HDFS-4465.patch
          13 kB
          Aaron Myers
        4. HDFS-4465.patch
          9 kB
          Aaron Myers

          Issue Links

            Activity

              People

              • Assignee:
                atm Aaron Myers
                Reporter:
                sureshms Suresh Srinivas
              • Votes:
                0 Vote for this issue
                Watchers:
                14 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: