Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-9870

[R] Friendly interface for filesystems (S3)

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • R

    Description

      The Filesystem methods don't provide a human-friendly interface for basic operations like ls, mkdir, etc. Since we provide access to S3 and potentially other cloud storage, it would be nice to have simple methods for exploring it.

      Additional ideas:

      • S3Bucket class/constructor: it's basically a SubTreeFileSystem containing S3FS and a path, except that we can auto-detect a bucket's region.
      • Add a class like the FileLocator C++ struct list(fs, path). also kinda like a SubTreeFileSystem, but with different methods and intents. Aside from use in ls/mkdir/cp, it could be used in file reader/writers instead of having an extra filesystem argument added everywhere, e.g. fs$path("path/to/file"). See https://github.com/apache/arrow/pull/8197#discussion_r494325934

      Attachments

        Issue Links

          Activity

            People

              npr Neal Richardson
              npr Neal Richardson
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h
                  1h

                  Slack

                    Issue deployment