Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-5502

[R] file readers should mmap

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Not A Problem
    • None
    • 0.16.0
    • R
    • None

    Description

      Arrow is supposed to let you work with datasets bigger than memory. Memory mapping is a big part of that. It should be the default way that files are read in the `read_*` functions. To disable memory mapping, we could use a global `option()`, or a function argument, but that might clutter the interface. Or we could not give a choice and only fall back to not memory mapping if the platform/file system doesn't support it.

      Attachments

        Activity

          People

            Unassigned Unassigned
            npr Neal Richardson
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: