Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-11806 Spark 2.0 deprecations and removals
  3. SPARK-12790

Remove HistoryServer old multiple files format

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • Deploy
    • None

    Description

      HistoryServer has 2 formats. The old one makes a directory and puts multiple files in there (APPLICATION_COMPLETE, EVENT_LOG1 etc.). The new one has just 1 file called local_2593759238651.log or something.

      It's been a nightmare to maintain both code paths. We should just remove the old legacy format (which has been out of use for many versions now) when we still have the chance.

      Attachments

        Activity

          People

            felixcheung Felix Cheung
            andrewor14 Andrew Or
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: