Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9614

Disable error logging for all re2 library usage.

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • Impala 3.4.0
    • None
    • Backend
    • None
    • ghx-label-9

    Description

      Impala uses the re2 library for a number of purposes:

      • Built-in functions : REGEXP_REPLACE, REGEXP_EXTRACT, REGEXP_LIKE
      • SQL operators: REGEXP, RLIKE, LIKE
      • Log and query redaction.

      Logging errors is disabled for REGEXP_REPLACE and REGEXP_EXTRACT built-in functions. In all other cases logging errors is enabled. Right now this behavior is hard-coded and not configurable. In case every row causes an error, this can be problematic as re2 errors will flood the impala error logs.

      We should  disable error logging for all re2 library usage or make it configurable through an Impala startup flag.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            attilaj Attila Jeges

            Dates

              Created:
              Updated:

              Issue deployment