Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Duplicate
    • Affects Version/s: 0.2.0
    • Fix Version/s: 0.2.0
    • Component/s: None
    • Labels:
      None
    • Environment:

      large clusters

      Description

      When dfs.data.dir has multiple values, we currently start a DataNode for each (all in the same JVM). Instead we should run a single DataNode that stores block files into the different directories. This will reduce the number of connections to the namenode. We cannot hash because different devices might be different amounts full. So the datanode will need to keep a table mapping from block id to file location, and add new blocks to less full devices.

        Issue Links

          Activity

          Doug Cutting created issue -
          Sameer Paranjpye made changes -
          Field Original Value New Value
          Affects Version/s 0.1 [ 12310812 ]
          Fix Version/s 0.2 [ 12310813 ]
          Affects Version/s 0.2 [ 12310813 ]
          Fix Version/s 0.1 [ 12310812 ]
          Sameer Paranjpye made changes -
          Link This issue is duplicated by HADOOP-64 [ HADOOP-64 ]
          Sameer Paranjpye made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Duplicate [ 3 ]
          Doug Cutting made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Doug Cutting made changes -
          Workflow jira [ 12351915 ] no reopen closed [ 12373032 ]
          Doug Cutting made changes -
          Workflow no reopen closed [ 12373032 ] no-reopen-closed [ 12373368 ]
          Doug Cutting made changes -
          Workflow no-reopen-closed [ 12373368 ] no-reopen-closed, patch-avail [ 12377676 ]
          Owen O'Malley made changes -
          Component/s dfs [ 12310710 ]
          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Resolved Resolved
          13d 23h 45m 1 Sameer Paranjpye 25/Mar/06 06:18
          Resolved Resolved Closed Closed
          41d 23h 17m 1 Doug Cutting 06/May/06 05:35

            People

            • Assignee:
              Konstantin Shvachko
              Reporter:
              Doug Cutting
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development