Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7926 long-lived daemons for query fragment execution, I/O and caching
  3. HIVE-10132

LLAP: Tez heartbeats are delayed by ~500+ ms due to Hadoop IPC client

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: llap
    • Labels:
      None

      Description

      HADOOP-11772 has a clearer bug report of the core issue inside hadoop-common.

      Due to the delayed heartbeats reaching the AM, the reducers are losing up-to a couple of seconds for a 60ms (x10 parallel) mapper + 300ms reducer instead of finishing the query in under a second.

        Attachments

        1. HIVE-10132.NOT.A.patch
          3 kB
          Gopal Vijayaraghavan

          Activity

            People

            • Assignee:
              sseth Siddharth Seth
              Reporter:
              gopalv Gopal Vijayaraghavan
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: