Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-5697

Improve performance of filter operator for pattern matching

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.11.0
    • Fix Version/s: None
    • Component/s: Execution - Flow
    • Labels:

      Description

      Queries using filter with sql like operator use Java regex library for pattern matching. However, for cases like %abc (ends with abc), abc% (starts with abc), %abc% (contains abc), it is observed that implementing these cases with simple code instead of using regex library provides good performance boost (4-6x). Idea is to use special case code for simple, common cases and fall back to Java regex library for complicated ones. That will provide good performance benefit for most common cases.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ppenumarthy Padma Penumarthy
                Reporter:
                ppenumarthy Padma Penumarthy
              • Votes:
                1 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: