Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-8934

COPY command has inherent 128KB field size limit

    XMLWordPrintableJSON

    Details

    • Severity:
      Normal
    • Impacts:
      Docs

      Description

      In using the COPY command as follows:
      cqlsh -e "COPY test.test1mb(pkey, ccol, data) FROM 'in/data1MB/data1MB_9.csv'"
      the following error is thrown:
      <stdin>:1:field larger than field limit (131072)

      The data file contains a field that is greater than 128KB (it's more like almost 1MB).

      A work-around (thanks to Jeremiah Jordan and Tom Hobbs is to modify the cqlsh script and add the line
      csv.field_size_limit(1000000000)
      anywhere after the line
      import csv

        Attachments

        1. 8934-2.1.txt
          1.0 kB
          Philip Thompson
        2. 8934-2.0.txt
          0.9 kB
          Philip Thompson

          Activity

            People

            • Assignee:
              philipthompson Philip Thompson
              Reporter:
              brianmhess Brian Hess
              Authors:
              Philip Thompson
              Reviewers:
              Tom Hobbs
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: