Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3577

Tools to inject blocks into name node and simulated data nodes for testing

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.19.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This jira adds the following 2 features to src/test
      1) it extends DataNodeCluster to allow blocks to be injected for simulted data nodes.
      2) a new command, CreatedEditsLog which creates an NN image edits logs that has a transactions for new files. The edits log file can be copied to the NN's image.

      Using the two in conjunction one can inject a set of blocks in a NN and in a set of Datanodes and use it for testing, for example a cluster of 3K DNs

        Attachments

        1. inject3.patch
          24 kB
          Lohit Vijaya Renu
        2. inject2.patch
          24 kB
          Sanjay Radia
        3. inject.patch
          23 kB
          Sanjay Radia

          Activity

            People

            • Assignee:
              sanjay.radia Sanjay Radia
              Reporter:
              sanjay.radia Sanjay Radia
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: