Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-4860 Sort performance
  3. FLINK-4869

Store record pointer after record keys

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Minor
    • Resolution: Later
    • 1.2.0
    • None
    • None

    Description

      NormalizedKeySorter serializes records into a RandomAccessInputView separate from the memory segments used for the sort keys. By storing the pointer after the sort keys the addition of the offset is moved from NormalizedKeySorter.compare which is O(n log n)) to other methods which are O(n).

      Will run a performance comparison before submitting a PR to how significant a performance improvement this would yield.

      Attachments

        Activity

          People

            greghogan Greg Hogan
            greghogan Greg Hogan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: