Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
Impala 1.1
-
None
-
None
Description
We run into any number of difficulties because of parallel logging systems - glog for the C++ code, and log4j from Java. It would be very good to combine them.
Since we prefer glog, one solution would be to add a custom log4j appender that actually called back into C++ and invoked the right log method. We would need to check that there's no possibility of deadlock in doing so. We can't just write a custom logger, since we don't control all the places where log4j is invoked (say inside Hive).
We'd get several benefits - a uniform log message format, all log messages in one file - making it easy to reason about 'happened before' relationships, and a single way of managing log files.