[HDFS-13759] [HDFS Pagination]Does HDFS Java api Support Pagination?

• Type: Wish
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.6.0, 2.7.0, 2.8.0
• Component/s: fs, fs async
• Labels: HDFS pagination
• Assignee: Unassigned
• Reporter: wuchang
• Created: 22/Jul/18 12:23
• Updated: 03/Aug/19 07:37

Description

I could use FileSystem

RemoteIterator<FileStatus> listed = fs.listStatusIterator(new Path("hdfs://warehousestore/user/chang.wu/flat_level_1"));

like this to get files asynchronously.

But in fact what I want is a pagination support, where I could pass two parameters, the 

offset

and

limit

, like MySQL does to get part of files under some directory;.

I know I could just implement the pagination by wrapping the listStatusIterator, but I think it looks weird.

So, why can't HDFS support pagination for user directly?