[HAWQ-1769] fix DirectoryIterator of libhdfs

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.0.0
• Fix Version/s: backlog
• Component/s: libhdfs
• Assignee: Ruilong Huo
• Reporter: Zuoyan Qin
• Created: 21/Oct/20 06:23
• Updated: 31/Aug/21 01:07
• Resolved: 21/Oct/20 06:52

Description

The DirectoryIterator of libhdfs has some problems now:

• even if the `getListing` RPC returns "remainingentries = 0", the following invoking of DirectoryIterator::hasNext() may still trigger an unnecessary `getListing` RPC to the server.
• moreover, in the above case, if the server returns a non-empty list (so it is a server bug because the server should return an empty list) when the client send an unnecessary `getListing` RPC, then DirectoryIterator::hasNext() will return true, and we will enter endless loop.

Issue Links

• links to: GitHub Pull Request #1497