Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1386

Users should not need to setup TezGroupedInputFormat to enable grouping

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.5.0
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      To enable grouping via Tez, users should not need to change the underlying InputFormat. A simple enable / disable option should be sufficient.
      MRInputConfigurer does this.
      Many of the methods in MRHelpers, however, require an InputFormat to be specified. The main objective of this JIRA is to get rid of this requirement in favor of a simple enableGrouping flag.
      Marking this as a blocker for TEZ-1347, since it should simplify the set of APIs required. Also, making all the changes in TEZ-1347 would just lead to a very large patch.

        Attachments

        1. TEZ-1386.3.txt
          41 kB
          Siddharth Seth
        2. TEZ-1386.2.txt
          40 kB
          Siddharth Seth
        3. TEZ-1386.1.txt
          46 kB
          Siddharth Seth

          Issue Links

            Activity

              People

              • Assignee:
                sseth Siddharth Seth
                Reporter:
                sseth Siddharth Seth
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: