Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-7548

SQL COPY: handle CSV lines with less values than required correctly

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • 2.4
    • None
    • sql
    • None

    Description

      Currently some of lines in CSV files can have less values than declared in the command or CSV header.

      We need to think how do we handle such rows:

      • append empty values ("") for the missing trailing columns
      • append null values
      • reject such lines and report an error

      We might need a COPY command parameter to configure the desired behaviour.

      Attachments

        Issue Links

          is blocked by

          New Feature - A new feature of the product, which has yet to be developed. IGNITE-6917 SQL: implement COPY command for efficient data loading

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. IGNITE-7539 SQL COPY command: implement NULL escape sequence handling

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. IGNITE-7544 SQL COPY command: implement statistics gathering and error reporting

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. IGNITE-7546 SQL COPY command: implement CSV header row parsing

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              kirill.shirokov Kirill Shirokov
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: