Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3828

Write skipped records' bytes to DFS

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.19.0
    • None
    • None
    • Reviewed
    • Skipped records can optionally be written to the HDFS. Refer org.apache.hadoop.mapred.SkipBadRecords.setSkipOutputPath for setting the output path.

    Description

      This is an incremental step over HADOOP-153, which provides the base skipping functionality.

      Attachments

        1. 3828_v1.patch
          26 kB
          Sharad Agarwal
        2. 3828_v2.patch
          27 kB
          Sharad Agarwal
        3. 3828_v3.patch
          23 kB
          Sharad Agarwal
        4. 3828_v4.patch
          25 kB
          Sharad Agarwal

        Issue Links

          depends upon

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-153 skip records that fail Task

          • Major - Major loss of function.
          • Closed
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-1216 Show the row with error in mapper/reducer

          • Major - Major loss of function.
          • Closed

          Activity

            People

              sharadag Sharad Agarwal
              sharadag Sharad Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: