Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-17474 Optimise abfs incremental listings
  3. HADOOP-17492

abfs listLocatedStatus to support incremental/async page fetching

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.3.0
    • 3.3.5
    • fs/azure
    • None

    Description

      listLocatedStatus uses listStatus[] then serves up as an iterator.

      Once HADOOP-17475 is in, it can do the list incrementally with async prefetch.

      Although not used much in the Hadoop codebase, the LocationStatusFetcher class is used during query planning across applications

      Attachments

        Issue Links

          Activity

            People

              stevel@apache.org Steve Loughran
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: