Uploaded image for project: 'ORC'
  1. ORC
  2. ORC-115

Unable to write string data into ORC file (or at least read it back)

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.2.2
    • 1.2.3, 1.3.0
    • Java
    • None

    Description

      I'm trying to create a little utility to convert CSV files into ORC files. I've noticed that the resulting ORC files don't seem quite correct, though. In an effort to create a simple reproducible test case, I just changed the "Writing/Reading ORC Files" examples here:

      https://orc.apache.org/docs/core-java.html

      to create a file based on a pair of strings instead of integers. Basically I changed the loop as follows:

              BytesColumnVector first = (BytesColumnVector) writeBatch.cols[0];
              BytesColumnVector last = (BytesColumnVector) writeBatch.cols[1];
              for (int r = 0; r < 10; ++r)
              {
                  String firstName = ("First-" + r).intern();
                  String lastName = ("Last-" + (r * 3)).intern();
                  ...
              }
      

      The file writes without errors, and if I write it with no compression, I can see the data using strings my-file.orc. However, when I then try to read the data back from the file and print out the resulting batches to the console, I get the following:

      ["       ", "      "]
      ["       ", "      "]
      ["       ", "      "]
      ["       ", "      "]
      ["       ", "       "]
      ["       ", "       "]
      ["       ", "       "]
      ["       ", "       "]
      ["       ", "       "]
      ["       ", "       "]
      

      I've been completely unable to find any documentation or example code that would help me to understand why this isn't working. Any insights about what I may be doing wrong here would be greatly appreciated!

      Attachments

        Issue Links

          Activity

            People

              omalley Owen O'Malley
              scwells72 Scott Wells
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: