Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5904

Enable ThreadSanitizer for Impala

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Infrastructure
    • ghx-label-4

    Description

      It would be great to be able to automatically detect data races in Impala using ThreadSanitizer to avoid tricky-to-reproduce bugs. This issue tracks enabling ThreadSanitizer, fixing bugs and adding suppressions to get to the point where Impala runs cleanly with the sanitizer.

      Attachments

        1. impalad.ERROR
          1.91 MB
          Tim Armstrong

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-4658 Potential race if compiler reorders ReachedLimit() usage

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-9611 Hang in HandoffToProbesAndWait() for multithreaded join build

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-9612 Runtime filter wait longer than it should be

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-9840 ThreadSanitizer: data race internal-queue.h in InternalQueueBase::Enqueue

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-10121 bin/jenkins/finalize.sh should generate JUnitXML for TSAN failures

          • Major - Major loss of function.
          • Resolved
          1.
          		 Add ThreadSanitizer build Sub-task Resolved Tim Armstrong
          2.
          		 Add ThreadSanitizer to https://jenkins.impala.io/job/all-build-options/ Sub-task Resolved Tim Armstrong
          3.
          		 TSAN data race in ReservationTracker::used_reservation_ updates Sub-task Resolved Sahil Takiar
          4.
          		 TSAN data race in TmpFileMgr::File::Blacklist Sub-task Resolved Sahil Takiar
          5.
          		 Possible data race in TupleDescriptor::GetLlvmStruct Sub-task Resolved Sahil Takiar
          6.
          		 Template tuples are initialized multiple times Sub-task Resolved Sahil Takiar
          7.
          		 TSAN data race in kudu::Socket::Accept and TraceLog::UpdateCategoryGroupEnabledFlag Sub-task Resolved Unassigned
          8.
          		 TSAN data race in kudu::ScopedWatchKernelStack / KernelStackWatchdog Sub-task Resolved Unassigned
          9.
          		 Instantiations/ExprTest.MathConversionFunctions fails in TSAN builds Sub-task Resolved Unassigned
          10.
          		 Possible data race in kudu::security::InitKerberosForServer Sub-task Resolved Unassigned
          11.
          		 TSAN data race in RuntimeFilterBank::CancelLocked() Sub-task Resolved Tim Armstrong
          12.
          		 TSAN data races during impalad shutdown Sub-task Resolved Bikramjeet Vig
          13.
          		 Set halt_on_error=1 for TSAN builds Sub-task Resolved Sahil Takiar
          14.
          		 TSAN data race in hdfs-bulk-ops Sub-task Resolved Sahil Takiar
          15.
          		 Data race on Webserver::UrlHandler::is_on_nav_bar_ Sub-task Resolved Sahil Takiar
          16.
          		 Thrift server shutdown is racey Sub-task Open Unassigned
          17.
          		 Allow TSAN to be set on codegen Sub-task Open Unassigned
          18.
          		 Possible data race in BloomFilter::BucketFindAVX2 Sub-task Open Unassigned
          19.
          		 Compile thirdparty toolchain libs with TSAN Sub-task Open Unassigned
          20.
          		 TSAN error in ImpalaServer::QueryStateRecord::Init Sub-task Resolved Jason Fehr

          Activity

            People

              stakiar Sahil Takiar
              tarmstrong Tim Armstrong
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: