Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6858

INFORMATION_SCHEMA.`FILES` table not show any files if storage contains "write only" folder

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.15.0
    • Fix Version/s: 1.15.0
    • Component/s: None
    • Labels:

      Description

      Steps to reproduce bug:

      • storage contains folder with "write only" permission;
      • Drill option "storage.list_files_recursively" is false;
      • query result for "SELECT * FROM INFORMATION_SCHEMA.`FILES`;" shows the list of the files and folders for every workspace for each storage plugin;
      • set Drill option "storage.list_files_recursively" to true;
      • run query "SELECT * FROM INFORMATION_SCHEMA.`FILES`;"

      Actual result:

      Drill returns empty results table if workspace has a folder with "write only" permission. Even if this workspace contains files and folders, that have "read" access right.

      Expected result:

      Drill returns list of files for each folder with "read" permission and hide files list for "write only" folders. Showing only folders name when permission is "write only".

       

      This bug can be reproduced on "Amazon S3" and "File System"  Drill storage plugins.

       

      In "drillbit.log" for "File System"  Drill storage plugin:

      2018-11-15 20:20:19,760 [2412471b-a4f5-d247-0db6-5d50cdcef634:frag:0:0] WARN o.a.d.e.s.i.InfoSchemaRecordGenerator - Failure while trying to list files
      java.io.FileNotFoundException: file:///home/mapr/test/writeonly: null file list

       

      In "drillbit.log" for "Amazon S3"  Drill storage plugin:

      2018-11-15 16:50:04,735 [24127862-a0e3-02ad-6b66-d649a62e8b8a:frag:0:0] WARN o.a.d.e.s.i.InfoSchemaRecordGenerator - Failure while trying to list files
      java.io.FileNotFoundException: No such file or directory: s3a://bucket/writeonly

       

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                arina Arina Ielchiieva
                Reporter:
                denysord88 Denys Ordynskiy
                Reviewer:
                Volodymyr Vysotskyi
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: