Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-1894

GlobalDictionary may corrupt when server suddenly crash

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: v1.5.3
    • Fix Version/s: v1.5.3
    • Component/s: Metadata
    • Labels:
      None

      Description

      Global Dictionary store data on hdfs directly, and overwrite directly when data file updated. If the server crashed suddenly during writing file, the data file may be corrupt and can't be recovered.

      To resolve this problem, copy the data file into a tmp directory and copy back after the file is updated successfully.
      I'll post a patch later with this solution.

        Attachments

        1. KYLIN-1894.2.patch
          30 kB
          Yerui Sun
        2. KYLIN-1894.3.patch
          11 kB
          Yerui Sun

          Activity

            People

            • Assignee:
              sunyerui Yerui Sun
              Reporter:
              sunyerui Yerui Sun
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: