Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-8934

COPY command has inherent 128KB field size limit

Agile BoardAttach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Severity:
      Normal
    • Impacts:
      Docs

      Description

      In using the COPY command as follows:
      cqlsh -e "COPY test.test1mb(pkey, ccol, data) FROM 'in/data1MB/data1MB_9.csv'"
      the following error is thrown:
      <stdin>:1:field larger than field limit (131072)

      The data file contains a field that is greater than 128KB (it's more like almost 1MB).

      A work-around (thanks to Jeremiah Jordan and Tom Hobbs is to modify the cqlsh script and add the line
      csv.field_size_limit(1000000000)
      anywhere after the line
      import csv

        Attachments

        1. 8934-2.0.txt
          0.9 kB
          Philip Thompson
        2. 8934-2.1.txt
          1.0 kB
          Philip Thompson

          Activity

            People

            • Assignee:
              philipthompson Philip Thompson Assign to me
              Reporter:
              brianmhess Brian Hess
              Authors:
              Philip Thompson
              Reviewers:
              Tom Hobbs

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment