Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14106

Fix deprecated FileSystem inefficient calls in test

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • test
    • None

    Description

      HADOOP-13321 deprecates FileSystem APIs that promote inefficient call patterns. There are existing code patterns in tests and this JIRA is to address them.

      [WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractFSContractTestBase.java:[372,10] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[249,14] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[251,16] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[264,14] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[266,16] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[280,14] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[282,16] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[288,14] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[290,16] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[306,14] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[308,16] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[313,14] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[315,16] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[340,14] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[342,16] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[351,14] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[353,16] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[400,14] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[759,14] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFileSystemBaseTest.java:[761,16] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileSystemContractBaseTest.java:[124,18] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileSystemContractBaseTest.java:[129,18] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileSystemContractBaseTest.java:[134,42] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileSystemContractBaseTest.java:[135,18] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileSystemContractBaseTest.java:[139,18] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileSystemContractBaseTest.java:[143,18] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestPath.java:[419,18] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/TestChRootedFileSystem.java:[116,26] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/TestChRootedFileSystem.java:[117,32] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/TestChRootedFileSystem.java:[121,26] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/TestChRootedFileSystem.java:[122,32] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/TestChRootedFileSystem.java:[131,26] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/TestChRootedFileSystem.java:[132,32] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/TestChRootedFileSystem.java:[144,26] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/TestChRootedFileSystem.java:[145,32] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/TestChRootedFileSystem.java:[148,26] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/TestChRootedFileSystem.java:[149,32] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/TestChRootedFileSystem.java:[169,26] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/TestChRootedFileSystem.java:[170,32] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/TestChRootedFileSystem.java:[178,26] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/TestChRootedFileSystem.java:[179,32] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/TestChRootedFileSystem.java:[286,26] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellReturnCode.java:[399,22] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellReturnCode.java:[401,22] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java:[192,11] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java:[231,22] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java:[235,22] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java:[256,13] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java:[279,20] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java:[279,39] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java:[296,41] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java:[322,20] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java:[332,18] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java:[445,18] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java:[505,18] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestLocalFileSystem.java:[91,24] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestLocalFileSystem.java:[98,24] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestLocalFileSystem.java:[110,24] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShellGenericOptions.java:[107,19] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestQuota.java:[320,18] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestQuota.java:[1383,18] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestINodeFile.java:[778,19] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestINodeFile.java:[787,20] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestQuotaByStorageType.java:[834,18] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestQuotaByStorageType.java:[903,18] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSImage.java:[135,19] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSPermission.java:[1007,10] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/ErasureCodeBenchmarkThroughput.java:[406,32] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestFileSystemApplicationHistoryStore.java:[274,27] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestFileSystemApplicationHistoryStore.java:[283,23] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestFileSystemApplicationHistoryStore.java:[294,28] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestFileSystemApplicationHistoryStore.java:[305,23] [deprecation] isDirectory(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/SimpleCopyListing.java:[150,19] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/SimpleCopyListing.java:[457,39] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/mapred/TestCopyMapper.java:[331,26] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/mapred/TestCopyMapper.java:[331,51] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/mapred/TestCopyMapper.java:[340,27] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/mapred/TestCopyMapper.java:[999,12] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools/HadoopArchives.java:[485,13] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-tools/hadoop-azure-datalake/src/test/java/org/apache/hadoop/fs/adl/live/TestMetadata.java:[72,30] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-tools/hadoop-azure-datalake/src/test/java/org/apache/hadoop/fs/adl/live/TestMetadata.java:[91,30] [deprecation] isFile(Path) in FileSystem has been deprecated
[WARNING] /testptch/hadoop/hadoop-tools/hadoop-azure-datalake/src/test/java/org/apache/hadoop/fs/adl/live/TestMetadata.java:[104,24] [deprecation] isFile(Path) in FileSystem has been deprecated

      If there is any false alarming above, we can simply suppress the warnings. Thanks Steve for bringing this up.

      Attachments

        Issue Links

          contains

          Bug - A problem which impairs or prevents the functions of the product. YARN-6239 Fix javac warnings in YARN that caused by deprecated FileSystem APIs

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-14133 Fix javac warnings in Hadoop Common that caused by deprecated FileSystem APIs

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Patch Available

          Bug - A problem which impairs or prevents the functions of the product. HDFS-11455 Fix javac warnings in HDFS that caused by deprecated FileSystem APIs

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Patch Available

          Activity

            People

              linyiqun Yiqun Lin
              liuml07 Mingliang Liu
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: