[SPARK-27165] Upgrade Apache ORC to 1.5.5

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.1, 3.0.0
• Fix Version/s: 2.4.1, 3.0.0
• Component/s: Build
• Assignee: Dongjoon Hyun
• Reporter: Dongjoon Hyun
• Created: 14/Mar/19 22:20
• Updated: 23/Mar/19 17:40
• Resolved: 15/Mar/19 03:15

Description

This issue aims to update Apache ORC dependency to fix SPARK-27107 .

[ORC-452] Support converting MAP column from JSON to ORC
Improvement
[ORC-447] Change the docker scripts to keep a persistent m2 cache
[ORC-463] Add `version` command
[ORC-475] ORC reader should lazily get filesystem
[ORC-476] Make SearchAgument kryo buffer size configurable

Issue Links

• is related to: SPARK-27107 Spark SQL Job failing because of Kryo buffer overflow with ORC
• links to: GitHub Pull Request #24096
• links to: GitHub Pull Request #24097