Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9802 YARN Timeline Service v2 (post GA features)
  3. YARN-6382

Address race condition on TimelineWriter.flush() caused by buffer-sized flush

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.0.0-alpha2
    • None
    • None
    • None

    Description

      YARN-6376 fixes the race condition between putEntities() and periodical flush() by WriterFlushThread in TimelineCollectorManager, or between putEntities() in different threads.
      However, BufferedMutator can have internal size-based flush as well. We need to address the resulting race condition.

      Attachments

        Issue Links

          is related to

          Sub-task - The sub-task of the issue YARN-6376 Exceptions caused by synchronous putEntities requests can be swallowed

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue YARN-6047 Documentation updates for TimelineService v2

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              ykabusalah Yousef Abu-Salah
              haibochen Haibo Chen
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated: