Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-2913

Spark's log4j.properties should always appear ahead of Hadoop's on classpath

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Incomplete
    • Affects Version/s: 1.0.0, 1.0.2, 1.1.0
    • Fix Version/s: None
    • Component/s: Deploy
    • Labels:

      Description

      In the current compute-classpath scripts, the Hadoop conf directory may appear before Spark's conf directory in the computed classpath. This leads to Hadoop's log4j.properties being used instead of Spark's, preventing users from easily changing Spark's logging settings.

      To fix this, we should add a new classpath entry for Spark's log4j.properties file.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                joshrosen Josh Rosen
                Reporter:
                joshrosen Josh Rosen
              • Votes:
                1 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: