Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-4859

Log4J reinitialized/reconfigured by Spark Logging

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: v4.0.0-alpha
    • Fix Version/s: v4.0.0-beta
    • Component/s: Others
    • Labels:
      None

      Description

      Spark Logging was intrucoded in kylin 4.0-alpha, it uses SL4J too, but it will reinitialize log4j when RootLoggers's Appender is empty.

      See: https://github.com/apache/spark/blob/45e19bb99acd5066723fec2bbdc0c99c696c3daf/core/src/main/scala/org/apache/spark/internal/Logging.scala#L120

      this causes some logs of a query logged in file(kylin.log), the other logged in stdout(kylin.out) using configuration file log4j-defaults.properties in spark-core_2.11-2.x.x.jar

      not firendly to read and anlyze a query performance, and may cause other logging confusions

      To Avoid this is,  default appenders for rootLoggers should be set in kylin-server-log4j.properties

        Attachments

          Activity

            People

            • Assignee:
              zhengshengjun ShengJun Zheng
              Reporter:
              zhengshengjun ShengJun Zheng
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: