Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-1518

Spark master doesn't compile against hadoop-common trunk

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 1.0.1, 1.1.0
    • Spark Core
    • None

    Description

      FSDataOutputStream::sync() has disappeared from trunk in Hadoop; FileLogger.scala is calling it.

      I've changed it locally to hsync() so I can compile the code, but haven't checked yet whether those are equivalent. hsync() seems to have been there forever, so it hopefully works with all versions Spark cares about.

      Attachments

        Activity

          People

            cmccabe Colin McCabe
            vanzin Marcelo Masiero Vanzin
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: