Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-690 Tez API Ease of Use
  3. TEZ-698

Make it easy to create and configure MRInput/MROutput and other inputs/outputs

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.5.0
    • None
    • None
    • Reviewed

    Description

      We have moved away from MR and its not necessary for anyone to write mappers and reducers or to configure them. But MR input and output and Shuffle related inputs/outputs. Currently we have to invoke a host of methods to configure them. If we can have a single API to make these configs then it would really help. Secondly for IO pairs like ShuffleInput/SortedOutput, their configs are related (KV types e.g.) So it maybe useful to have a combined API that generates configs for both in a single API.

      Attachments

        1. TEZ-698.1.patch
          31 kB
          Bikas Saha
        2. TEZ-698.2.patch
          31 kB
          Bikas Saha

        Issue Links

          Activity

            People

              bikassaha Bikas Saha
              bikassaha Bikas Saha
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: