[IMPALA-7003] Support erasure-coding in impala

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 3.1.0
• Fix Version/s: Impala 4.3.0
• Component/s: Frontend, Infrastructure
• Target Version: Product Backlog
• Epic Color: ghx-label-1
• Assignee: Michael Smith
• Reporter: Tianyi Wang
• Created: 09/May/18 21:43
• Updated: 31/Jan/23 16:54
• Resolved: 31/Jan/23 16:54

Description

This is the parent Jira for the erasure coding feature

Issue Links

• is related to: IMPALA-11476 Support for Ozone with Erasure Coding
• is related to: IMPALA-7102 Add a query option to enable/disable running queries erasure coded files
• relates to: HDDS-3816 Erasure Coding

Sub-Tasks

• Make it possible to start the minicluster with HDFS erasure coding enabled: Resolved
• Deflake erasure coding data loading: Resolved
• Discard block locations and schedule as remote read with erasure coding: Resolved
• Re-enable EC tests broken by HDFS-13539: Resolved
• Print EC info in the query plan and profile: Resolved
• Re-enable blocksize-related tests under EC: Resolved
• Enable file handle cache for EC files: Resolved
• SHOW and DESCRIBE statements should display EC policies: Resolved
• Add EC metrics to impala-server: Resolved
• Switch allow_erasure_coded_files default to true: Resolved
• Add EC metrics for bytes written: Closed