Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-7019

[Java] Improve the performance of loading validity buffers

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.16.0
    • Java

    Description

      At the receiver side of flighting, loading validity buffer is an important operation, as each vector has a validity buffer.

      For non-nullable vectors, the current implementation of loading the validity buffer is inefficient. We improve the performance of this operation by efficiently setting the bits of a memory region to 1.

      Benchmark results show that the changes leads to a 35% performance improvement:

      Before:
      BitVectorHelperBenchmarks.loadValidityBufferAllOne avgt 5 748.916 ± 23.290 ns/op

      After:
      BitVectorHelperBenchmarks.loadValidityBufferAllOne avgt 5 487.352 ± 15.046 ns/op

      Attachments

        Issue Links

          Activity

            People

              fan_li_ya Liya Fan
              fan_li_ya Liya Fan
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 20m
                  1h 20m