Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8006

Consider replacing the modulus in KrpcDatastreamSender with fast mod

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: Impala 3.1.0
    • Fix Version/s: None
    • Component/s: Distributed Exec
    • Labels:

      Description

      Todd Lipcon  pointed out that there is potential improvement which can be implemented for the modulus used in our sender for the partitioning exchanges:

      http://www.idryman.org/blog/2017/05/03/writing-a-damn-fast-hash-table-with-tiny-memory-footprints/ (Optimizing Division for Hash Table Size).

      We should evaluate its effectiveness and implement it for KrpcDataStreamSender if appropriate.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              kwho Michael Ho
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: