Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-12589

NPE on querying external tables pointing to a single file

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 4.2.0, Impala 4.3.0
    • Impala 4.4.0
    • Frontend
    • None

    Description

      IMPALA-11507 brought in changes for relative/absolute paths, and made it impossible to query external tables pointing to a single file. HdfsPartition.getPath() returns null instead of empty path during computeEstimatedTableSize().

      Example:

      create external table t1(c1 int) stored as textfile;
      insert into t1 values (1);
      show files in t1;
      <copy the file to a tmp location>
      <rm the LOCATION directory of t1>
      <cp/mv the copied file to the LOCATION path>
      invalidate metadata t1;
      select count(*) from t1; 

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            rizaon Riza Suminto
            prozsa Peter Rozsa
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment