Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2584

Check for serializers early, and give out more information regarding missing serializers

    Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.20.2
    • Fix Version/s: None
    • Component/s: task
    • Labels:
    • Release Note:
      Check for proper Key/Value serializers during submission of MR jobs.
    • Tags:
      serializers
    • Target Version/s:

      Description

      As discussed on HADOOP-7328, MapReduce can handle serializers in a much better way in case of bad configuration, improper imports (Some odd Text class instead of the Writable Text set as key), etc..

      This issue covers the MapReduce parts of the improvements (made to IFile, MapOutputBuffer, etc. and possible early-check of serializer availability pre-submit) that provide more information than just an NPE as is the current case.

      1. MAPREDUCE-2584.r9.diff
        9 kB
        Harsh J
      2. MAPREDUCE-2584.r8.diff
        8 kB
        Harsh J
      3. MAPREDUCE-2584.r7.diff
        7 kB
        Harsh J
      4. MAPREDUCE-2584.r7.diff
        7 kB
        Harsh J
      5. MAPREDUCE-2584.r6.diff
        8 kB
        Harsh J
      6. MAPREDUCE-2584.r5.diff
        8 kB
        Harsh J
      7. MAPREDUCE-2584.r4.diff
        7 kB
        Harsh J
      8. MAPREDUCE-2584.r3.diff
        7 kB
        Harsh J
      9. MAPREDUCE-2584.r2.diff
        5 kB
        Harsh J

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Harsh J
              Reporter:
              Harsh J
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:

                Development