Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-958

Excessively long query plan serialization time in FE when querying huge tables

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: Impala 1.3
    • Fix Version/s: Impala 1.4.2, Impala 2.0
    • Component/s: None
    • Labels:
      None

      Description

      When the table is huge (i.e. has lots of blocks replica), it took >30 sec just to serialize the query plan, even though the actual planning process didn't take more than a sec. There's room for improvement in the FE-BE thrift structure to improve this timing.

      For a medium size table with less than 100 blocks, we've also observed that the query plan serialization time can vary from 1sec to 15+sec. It's possible that it's due to Java GC.

        Attachments

          Activity

            People

            • Assignee:
              dhecht Dan Hecht
              Reporter:
              marcelk Marcel Kornacker
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: