Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-35783

Set the list of read columns in the task configuration to reduce reading of ORC data.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.3, 3.1.2, 3.2.0
    • 3.2.0, 3.1.3, 3.0.4
    • SQL
    • None

    Description

      Now, the ORC reader will read all columns of the ORC table when the task configuration does not set the read column list. Therefore, we should set the list of read columns in the task configuration to reduce reading of ORC data.

      Attachments

        Activity

          People

            weixiuli weixiuli
            weixiuli weixiuli
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: