Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5384

Simplify coordinator locking protocol

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 2.9.0
    • Impala 2.13.0, Impala 3.1.0
    • None
    • None
    • ghx-label-5

    Description

      The coordinator has a central lock (lock_) which is used very liberally to synchronize state changes that don't need to be synchronized, creating a concurrency bottleneck.

      Also, the coordinator contains a number of data structures related to INSERT finalization that don't need to be part of and synchronized with the rest of the coordinator state.

      Attachments

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-6338 Tests fail due to runtime profile for query with limit missing pieces

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          breaks

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-7055 test_avro_writer failing on upstream Jenkins (Expected exception: "Writing to table format AVRO is not supported")

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          is depended upon by

          Sub-task - The sub-task of the issue IMPALA-5119 Don't make RPCs from Coordinator::UpdateBackendExecStatus()

          • Major - Major loss of function.
          • Open

          Activity

            People

              dhecht Daniel Hecht
              marcelk Marcel Kinard
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: