Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4544

Data loading without snapshot fails with ASAN

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: Impala 2.8.0
    • Fix Version/s: Impala 2.9.0
    • Component/s: Infrastructure
    • Labels:
    • Environment:
      ec2 c4.4xl, Ubuntu 14.04

      Description

      Setting CMAKE_BUILD_TYPE=ADDRESS_SANITIZER and loading test data from scratch fails:

      Executing: create-load-data.sh 
      Loading Hive Builtins (logging to /home/ubuntu/Impala/logs/data_loading/load-hive-builtins.log)... 
          OK (Took: 2 min 40 sec)
      Generating HBase data (logging to /home/ubuntu/Impala/logs/data_loading/create-hbase.log)... 
          OK (Took: 0 min 17 sec)
      Creating /test-warehouse HDFS directory (logging to /home/ubuntu/Impala/logs/data_loading/create-test-warehouse-dir.log)... 
          OK (Took: 0 min 2 sec)
      Derived params for create-load-data.sh:
      EXPLORATION_STRATEGY=exhaustive
      SKIP_METADATA_LOAD=0
      SKIP_SNAPSHOT_LOAD=0
      SNAPSHOT_FILE=
      CM_HOST=
      REMOTE_LOAD=
      Starting Impala cluster (logging to /home/ubuntu/Impala/logs/data_loading/start-impala-cluster.log)... 
          FAILED (Took: 0 min 11 sec)
          '/home/ubuntu/Impala/bin/start-impala-cluster.py --log_dir=/home/ubuntu/Impala/logs/data_loading -s 3' failed. Tail of log:
      Log for command '/home/ubuntu/Impala/bin/start-impala-cluster.py --log_dir=/home/ubuntu/Impala/logs/data_loading -s 3'
      Starting State Store logging to /home/ubuntu/Impala/logs/data_loading/statestored.INFO
      Starting Catalog Service logging to /home/ubuntu/Impala/logs/data_loading/catalogd.INFO
      Error starting cluster: Unable to start catalogd. Check log or file permissions for more details.
      Error in /home/ubuntu/Impala/testdata/bin/create-load-data.sh at line 48: SNAPSHOT_FILE=""
      

      From logs/data_loading/catalogd.ERROR:

      ASAN:DEADLYSIGNAL
      =================================================================
      ==25935==ERROR: AddressSanitizer: SEGV on unknown address 0x7f6f2437f014 (pc 0x7f71008fc874 bp 0x7ffdaee505a8 sp 0x7ffdaee504b0 T0)
          #0 0x7f71008fc873  (<unknown module>)
      
      AddressSanitizer can not provide additional info.
      SUMMARY: AddressSanitizer: SEGV (<unknown module>) 
      ==25935==ABORTING
      

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jbapple Jim Apple
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: