[IMPALA-10695] impala need use an independent disk io queue for JindoFS

• Type: Improvement
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: Impala 4.1.0
• Component/s: Backend
• Epic Color: ghx-label-8
• Assignee: Yong Yang
• Reporter: Yong Yang
• Created: 06/May/21 11:33
• Updated: 14/Nov/22 06:56
• Resolved: 17/Apr/22 12:21

Description

So far, the S3A, Adls and ABFS have dedicate queues in impala IO path. Ali cloud has similar target, like oss and jfs.

To improve the query IO performance when target files are stored in oss/jfs, it is necessary to create a dedicate queue for that.

 

BTW, I have some code ready for that when I am optimizing this situation. Please share your opinion if I should commit that part code.

Issue Links

• is related to: IMPALA-11683 Support Aliyun OSS File System