Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-1518

Spark master doesn't compile against hadoop-common trunk

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.0.1, 1.1.0
    • Component/s: Spark Core
    • Labels:
      None

      Description

      FSDataOutputStream::sync() has disappeared from trunk in Hadoop; FileLogger.scala is calling it.

      I've changed it locally to hsync() so I can compile the code, but haven't checked yet whether those are equivalent. hsync() seems to have been there forever, so it hopefully works with all versions Spark cares about.

        Attachments

          Activity

            People

            • Assignee:
              cmccabe Colin McCabe
              Reporter:
              vanzin Marcelo Masiero Vanzin
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: