Major Description
Currently, CopyableDatasets such as RecursiveCopyableDataset apply pathfilters only to files and not to directories. As a result, "hidden" and temporary directories (and their contents) can get listed for distcp. We ideally want to control whether pathfilters should be applied to directories via a config property.