Avro
  1. Avro
  2. AVRO-513

java mapreduce api should pass iterator of matching objects to reduce

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: 1.4.0
    • Component/s: java
    • Labels:
      None

      Description

      The Java mapreduce API added in AVRO-493 requires reducers implementations to explicitly detect sequences of matching data.

      Rather the reduce method might better look something like:

      void reduce(Iterator<IN>, Collector<OUT>);

      Where all equal values are passed in a single call.

      1. AVRO-513.patch
        8 kB
        Doug Cutting
      2. AVRO-513.patch
        7 kB
        Doug Cutting
      3. AVRO-513.patch
        7 kB
        Doug Cutting
      4. AVRO-513.patch
        7 kB
        Doug Cutting

        Issue Links

          Activity

          Doug Cutting created issue -
          Doug Cutting made changes -
          Field Original Value New Value
          Fix Version/s 1.4.0 [ 12314789 ]
          Doug Cutting made changes -
          Attachment AVRO-513.patch [ 12447044 ]
          Doug Cutting made changes -
          Attachment AVRO-513.patch [ 12447070 ]
          Doug Cutting made changes -
          Attachment AVRO-513.patch [ 12447079 ]
          Doug Cutting made changes -
          Attachment AVRO-513.patch [ 12447168 ]
          Doug Cutting made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Doug Cutting made changes -
          Link This issue is duplicated by AVRO-581 [ AVRO-581 ]
          Doug Cutting made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Duplicate [ 3 ]
          Doug Cutting made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Doug Cutting
              Reporter:
              Doug Cutting
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development