Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
Impala 3.4.0
-
None
-
None
-
ghx-label-9
Description
Impala uses the re2 library for a number of purposes:
- Built-in functions : REGEXP_REPLACE, REGEXP_EXTRACT, REGEXP_LIKE
- SQL operators: REGEXP, RLIKE, LIKE
- Log and query redaction.
Logging errors is disabled for REGEXP_REPLACE and REGEXP_EXTRACT built-in functions. In all other cases logging errors is enabled. Right now this behavior is hard-coded and not configurable. In case every row causes an error, this can be problematic as re2 errors will flood the impala error logs.
We should disable error logging for all re2 library usage or make it configurable through an Impala startup flag.
Attachments
Issue Links
- causes
-
IMPALA-5256 ERROR log files can get very large
- Resolved