Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8463

skip.header.line.count ignored on local catalog

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • Impala 3.1.0, Impala 3.2.0, Impala 3.3.0
    • Impala 3.3.0
    • Catalog
    • None

    Description

      test_text_scanner_with_header() fails when run against local catalog.

      [tarmstrong-box2.ca.cloudera.com:21000] functional> select c1, c2 from table_with_header
                                                        > ;
      Query: select c1, c2 from table_with_header
      Query submitted at: 2019-04-25 22:47:52 (Coordinator: http://2c766e5e2187:25000)
      Query progress can be monitored at: http://2c766e5e2187:25000/query_plan?query_id=68403d93ac914925:394ee6a100000000
      +------+------+
      | c1   | c2   |
      +------+------+
      | 5    | 6    |
      | 1    | 2    |
      | 3    | 4    |
      | NULL | NULL |
      +------+------+
      WARNINGS: Error converting column: 0 to INT
      Error converting column: 1 to DOUBLE
      Error parsing row: file: hdfs://172.19.0.1:20500/test-warehouse/table_with_header/table_with_header.csv, before offset: 22
      

      This is suspicious in LocalFsTable.java

        @Override
        public int parseSkipHeaderLineCount(StringBuilder error) {
          // TODO Auto-generated method stub
          return 0;
        }
      

      Attachments

        Activity

          People

            tarmstrong Tim Armstrong
            tarmstrong Tim Armstrong
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: