Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21951

Llap query on external table with header or footer returns incorrect row count.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 2.4.0, 3.2.0, 4.0.0
    • Fix Version/s: None
    • Component/s: llap, Query Processor
    • Labels:
      None

      Description

      Create a table with header and footer as follows.

      CREATE EXTERNAL TABLE IF NOT EXISTS externaltableOpenCSV (eid int, name String, salary String, destination String)
       COMMENT 'Employee details'
       ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.OpenCSVSerde'
       STORED AS TEXTFILE
       LOCATION '/externaltableOpenCSV'
       tblproperties ("skip.header.line.count"="1", "skip.footer.line.count"="2");
      

      Now, query on this table returns incorrect row count as header/footer are not skipped.

        Attachments

        1. HIVE-21951.01.patch
          23 kB
          Sankar Hariappan
        2. HIVE-21951.02.patch
          28 kB
          Sankar Hariappan

          Issue Links

            Activity

              People

              • Assignee:
                sankarh Sankar Hariappan
                Reporter:
                sankarh Sankar Hariappan
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: