[HADOOP-2055] JobConf should have a setInputPathFilter method - ASF JIRA

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Hadoop Flags:

Reviewed
Release Note:

Hide
This issue provides users the ability to specify what paths to ignore for processing in the job input directory (apart from the filenames that start with "_" and "."). Defines two new APIs - FileInputFormat.setInputPathFilter(JobConf, PathFilter), and, FileInputFormat.getInputPathFilter(JobConf).

Show
This issue provides users the ability to specify what paths to ignore for processing in the job input directory (apart from the filenames that start with "_" and "."). Defines two new APIs - FileInputFormat.setInputPathFilter(JobConf, PathFilter), and, FileInputFormat.getInputPathFilter(JobConf).

It should be possible to set a PathFilter for the input to avoid taking certain files as input data within the input directories.

Comment

JobConf should have a setInputPathFilter method