Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2225

MultipleOutputs should not require the use of 'Writable'

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.20.1
    • 0.23.0
    • job submission
    • None
    • Linux

    • Reviewed
    • MultipleOutputs should not require the use/check of 'Writable' interfaces in key and value classes.
    • multipleoutputs, writable, serialization

    Description

      MultipleOutputs right now requires for Key/Value classes to utilize the Writable and WritableComparable interfaces, and fails if the associated key/value classes aren't doing so.

      With support for alternates like Avro serialization, using Writables isn't necessary and thus the MO class must not strictly check for them.

      And since comparators may be given separately, key class doesn't need to be checked for implementing a comparable (although it is good design if the key class does implement Comparable at least).

      Am not sure if this brings about an incompatible change (does Java have BIC? No idea).

      Attachments

        Activity

          People

            qwertymaniac Harsh J
            qwertymaniac Harsh J
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 1m
                1m
                Remaining:
                Remaining Estimate - 1m
                1m
                Logged:
                Time Spent - Not Specified
                Not Specified