Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-2667

Errors in scanner prepare are not handled

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: Impala 2.3.0
    • Fix Version/s: Impala 2.5.0
    • Component/s: None

      Description

      Errors are logged in some cases, but the code attempts to use the scanner even if preparation failed, which will result in a crash:

      In HdfsScanNode::ScannerThread:

            Status scanner_status;
            HdfsScanner* scanner = CreateAndPrepareScanner(partition, context, &scanner_status);
            if (VLOG_QUERY_IS_ON && (!scanner_status.ok() || scanner == NULL)) {
              stringstream ss;
              ss << "Error preparing text scanner for scan range " << scan_range->file() <<
                  "(" << scan_range->offset() << ":" << scan_range->len() << ").";
              ss << endl << runtime_state_->ErrorLog();
              VLOG_QUERY << ss.str();
            }
      
            status = scanner->ProcessSplit();
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                tarmstrong Tim Armstrong
                Reporter:
                tarmstrong Tim Armstrong
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: