Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5008

LeveldbRMStateStore database can grow substantially leading to long recovery times

    Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      On large clusters with high application churn the background compaction in leveldb may not be able to keep up with the write rate. This can lead to large leveldb databases that take many minutes to recover despite not having very much real data in the database to load. Most the time is spent traversing tables full of keys that have been deleted.

        Attachments

          Activity

            People

            • Assignee:
              jlowe Jason Lowe
              Reporter:
              jlowe Jason Lowe
            • Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: