Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-321 [Umbrella] Generic application history service
  3. YARN-1364

Limit the number of outstanding tfile writers in FileSystemApplicationHistoryStore

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • None
    • None

    Description

      It seems to be expensive to maintain a big number of outstanding t-file writers. RM is likely to run out of the I/O resources. Probably we'd like to limit the number of concurrent outstanding t-file writers, and queue the writing requests.

      Attachments

        Activity

          People

            zjshen Zhijie Shen
            zjshen Zhijie Shen
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: