Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-33381

Support split big parquet file to multi InputSplits

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Connectors / Hive
    • None

    Description

      Currently, Flink only supports dividing a Parquet file into a split.
      But in some cases, one parquet file is too big for one task.
      In this case, we need to split one parquet file to multi splits.

      Attachments

        Activity

          People

            Unassigned Unassigned
            yunfanfighting@foxmail.com yunfan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: