[DRILL-6858] INFORMATION_SCHEMA.`FILES` table not show any files if storage contains "write only" folder

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.15.0
• Fix Version/s: 1.15.0
• Labels: ready-to-commit
• Assignee: Arina Ielchiieva
• Reporter: Denys Ordynskiy
• Reviewer: Vova Vysotskyi
• Created: 15/Nov/18 19:35
• Updated: 28/Nov/18 10:46
• Resolved: 26/Nov/18 16:34

Description

Steps to reproduce bug:

• storage contains folder with "write only" permission;
• Drill option "storage.list_files_recursively" is false;
• query result for "SELECT * FROM INFORMATION_SCHEMA.`FILES`;" shows the list of the files and folders for every workspace for each storage plugin;
• set Drill option "storage.list_files_recursively" to true;
• run query "SELECT * FROM INFORMATION_SCHEMA.`FILES`;"

Actual result:

Drill returns empty results table if workspace has a folder with "write only" permission. Even if this workspace contains files and folders, that have "read" access right.

Expected result:

Drill returns list of files for each folder with "read" permission and hide files list for "write only" folders. Showing only folders name when permission is "write only".

 

This bug can be reproduced on "Amazon S3" and "File System"  Drill storage plugins.

 

In "drillbit.log" for "File System"  Drill storage plugin:

2018-11-15 20:20:19,760 [2412471b-a4f5-d247-0db6-5d50cdcef634:frag:0:0] WARN o.a.d.e.s.i.InfoSchemaRecordGenerator - Failure while trying to list files
java.io.FileNotFoundException: file:///home/mapr/test/writeonly: null file list

 

In "drillbit.log" for "Amazon S3"  Drill storage plugin:

2018-11-15 16:50:04,735 [24127862-a0e3-02ad-6b66-d649a62e8b8a:frag:0:0] WARN o.a.d.e.s.i.InfoSchemaRecordGenerator - Failure while trying to list files
java.io.FileNotFoundException: No such file or directory: s3a://bucket/writeonly

 

 

Issue Links

• links to: GitHub Pull Request #1547