Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1113

Collapse equal keys in PipelinedSorter

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Key comparisons which result in equality are ignored in PipelinedSorter now.

      Since the basic characteristic of this sorter is that offsets only grow in one direction, we can avoid a large number of comparisons by collapsing keys into one another when they are equal.

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. TEZ-1228 Prototype IFile : Define a memory & merge optimized vertex-intermediate file format for Tez

          • Major - Major loss of function.
          • Closed

          Activity

            People

              gopalv Gopal Vijayaraghavan
              gopalv Gopal Vijayaraghavan
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: