Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-6442

Misleading file offset reporting in error messages

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: Impala 2.11.0
    • Fix Version/s: Impala 3.1.0
    • Component/s: Backend
    • Labels:

      Description

      HdfsParquetScanner::ProcessFooter has an error message "File $0 has invalid file metadata at file offset $1." However, the value reported as "file offset" is an offset from theĀ end of the file, not from its beginning. This is very misleading, since without explicitly stating that the offset is from the end, it is usually understood to be counted from the beginning.

      Additionally, although the function name is clearly about a "footer", two comments explicitly mention processing the "header". This falsely suggests that metadata is at the beginning of the file, when in reality it is at the end.

        Attachments

          Activity

            People

            • Assignee:
              yzhangal Yongjun Zhang
              Reporter:
              zi Zoltan Ivanfi
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: