Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-22202

Thread safety in ParquetColumnarRowInputFormat

    XMLWordPrintableJSON

    Details

      Description

      In a VectorizedColumnBatch, the dictionary will be lazied deserialized. 

      If there are multiple batches at the same time, there may be thread safety problems, because the deserialization of the dictionary depends on some internal structures.

      We need set numBatchesToCirculate to 1 for ParquetColumnarRowInputFormat.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                lzljs3620320 Jingsong Lee
                Reporter:
                lzljs3620320 Jingsong Lee
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: