Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-1894

GlobalDictionary may corrupt when server suddenly crash

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • v1.5.3
    • v1.5.3
    • Metadata
    • None

    Description

      Global Dictionary store data on hdfs directly, and overwrite directly when data file updated. If the server crashed suddenly during writing file, the data file may be corrupt and can't be recovered.

      To resolve this problem, copy the data file into a tmp directory and copy back after the file is updated successfully.
      I'll post a patch later with this solution.

      Attachments

        1. KYLIN-1894.2.patch
          30 kB
          Yerui Sun
        2. KYLIN-1894.3.patch
          11 kB
          Yerui Sun

        Activity

          People

            sunyerui Yerui Sun
            sunyerui Yerui Sun
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: