Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-6126

[C++] IPC stream reader handling of empty streams potentially not robust

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.15.0
    • C++

    Description

      If dictionaries are expected in a stream, but the stream terminates, then "empty stream" logic is triggered to suppress errors, see

      https://github.com/apache/arrow/blob/master/cpp/src/arrow/ipc/reader.cc#L482

      It's probably esoteric but this "empty stream" logic will trigger if the stream terminates in the middle of the dictionary messages, which is a legitimate error. So we should only bail out early (concluding that we have an empty stream) if the first dictionary message is null

      Attachments

        Issue Links

          Activity

            People

              wesm Wes McKinney
              wesm Wes McKinney
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2.5h
                  2.5h