Uploaded image for project: 'Apache Sedona'
  1. Apache Sedona
  2. SEDONA-63

Return immediately if one of the sides is empty in NestedLoopJudgement

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • None
    • 1.1.0

    Description

      This is already implemented i the indexed join judgements.

      If one of the sides is empty the join task won't produce any result. In that case we can skip initPartition() and materializing the left side.

      This shaves of 10% of the execution time for one of our jobs with skewed partitions. 

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              umartin Martin Andersson
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h