Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-398

[Java] Java file format requires bitmaps of all 1's to be written when there are no nulls

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • None
    • 0.2.0
    • Java
    • None

    Description

      From the format specification "Arrays having a 0 null count may choose to not allocate the null bitmap. Implementations may choose to always allocate one anyway as a matter of convenience, but this should be noted when memory is being shared."

      When the null count is 0 and the validity buffer has length 0, then in Java for now the simplest thing will be to allocate a new validity buffer with all 1's. See the corresponding C++ logic where a 0-length buffer is being written when the null count is 0: https://github.com/apache/arrow/blob/master/cpp/src/arrow/ipc/adapter.cc#L83

      Attachments

        Issue Links

          Activity

            People

              julienledem Julien Le Dem
              wesm Wes McKinney
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: