Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3609

Improve ATSv15 performance for DAG entities read calls.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.9.0, 0.8.5
    • None
    • None

    Description

      TimelineCachePluginImpl generates TimelineEntityGroupId.newInstance(appId, appId.toString()) as an EntityGroupId for dag entities. This results entities in file based on application EntityGroupId to loaded by ATS during a read operation. This file can become very large in long running AM and causes timeout and delays in ATS.

      Removing this id, reduces this parsing time and prevents the application entities from being loaded into cache.

      Attachments

        1. TEZ-3609.01.patch
          8 kB
          Harish JP

        Activity

          People

            harishjp Harish JP
            harishjp Harish JP
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: