Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1386

Users should not need to setup TezGroupedInputFormat to enable grouping

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.5.0
    • None
    • None

    Description

      To enable grouping via Tez, users should not need to change the underlying InputFormat. A simple enable / disable option should be sufficient.
      MRInputConfigurer does this.
      Many of the methods in MRHelpers, however, require an InputFormat to be specified. The main objective of this JIRA is to get rid of this requirement in favor of a simple enableGrouping flag.
      Marking this as a blocker for TEZ-1347, since it should simplify the set of APIs required. Also, making all the changes in TEZ-1347 would just lead to a very large patch.

      Attachments

        1. TEZ-1386.3.txt
          41 kB
          Siddharth Seth
        2. TEZ-1386.2.txt
          40 kB
          Siddharth Seth
        3. TEZ-1386.1.txt
          46 kB
          Siddharth Seth

        Issue Links

          Activity

            People

              sseth Siddharth Seth
              sseth Siddharth Seth
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: