[IMPALA-9400] Impala Ozone Support

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.2.0
• Component/s: Backend, Frontend
• Labels: ozone
• Target Version: Impala 4.3.0
• Epic Color: ghx-label-8
• Assignee: Michael Smith
• Reporter: Sahil Takiar
• Created: 18/Feb/20 23:02
• Updated: 27/Jan/23 21:57
• Resolved: 28/Nov/22 17:47

Description

Impala should be able to read/write data from Apache Ozone: https://hadoop.apache.org/ozone/

Issue Links

• causes: IMPALA-11448 Always assign Ozone I/O to remote thread group to improve performance
• is related to: IMPALA-11767 Hudi tests fail on Ozone with INVALID_VOLUME_NAME org.apache.hadoop.ozone.om.exceptions.OMException: Bucket or Volume name cannot start with a period or dash
• is related to: IMPALA-11754 Fixes for Impala+Ozone and erasure coding
• is related to: IMPALA-11867 Add Ozone to docs

Sub-Tasks

• Add Ozone to minicluster: Resolved
• Test coverage for Ozone Transparent Data Encryption: Resolved
• Change hadoop-ozone-filesystem dependency to hadoop-ozone-filesystem-lib-current: Resolved
• Support ofs scheme: Resolved
• Ozone support for load data inpath: Resolved
• Handle block location for Ozone: Resolved
• Ozone support for file handle cache: Resolved
• Remove o3fs default filesystem support: Resolved
• Fix hdfs_zone_alias_conf with Ozone: Closed
• Enable SkipIf tests specific to HDFS for Ozone: Resolved