Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-333

we should have some checks that the sort benchmark generates correct outputs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.12.0
    • None
    • None

    Description

      We should implement some checks of the input versus output of the sort benchmark to get some correctness guarantees:

      1. the number of records
      2. the number of bytes
      3. the output records are in fact sorted
      4. the xor of the md5 of each record's key/value pair

      Attachments

        1. HADOOP-333_20070213_1.patch
          14 kB
          Arun Murthy
        2. HADOOP-333_20070214_2.patch
          18 kB
          Arun Murthy
        3. HADOOP-333_20070215_3.patch
          19 kB
          Arun Murthy
        4. HADOOP-333_20070216_4.patch
          19 kB
          Arun Murthy

        Issue Links

          is part of

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-1014 map/reduce is corrupting data between map and reduce

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Activity

            People

              acmurthy Arun Murthy
              omalley Owen O'Malley
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: