Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13321

Deprecate FileSystem APIs that promote inefficient call patterns.

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha4
    • Fix Version/s: 3.0.0-alpha4
    • Component/s: fs
    • Labels:
      None

      Description

      FileSystem contains several methods that act as convenience wrappers over calling getFileStatus and retrieving a single property of the returned FileStatus. These methods have a habit of fostering inefficient call patterns in applications, resulting in multiple redundant getFileStatus calls. For HDFS, this translates into wasteful NameNode RPC traffic. For file systems backed by cloud object stores, this translates into wasteful HTTP traffic. This issue proposes to deprecate these methods and instead encourage applications to call getFileStatus and then reuse the same FileStatus instance as needed.

      1. HADOOP-13321.004.patch
        6 kB
        Mingliang Liu
      2. HADOOP-13321.003.patch
        4 kB
        Mingliang Liu
      3. HADOOP-13321.002.patch
        2 kB
        Mingliang Liu
      4. HADOOP-13321.001.patch
        3 kB
        Mingliang Liu
      5. HADOOP-13321.000.patch
        3 kB
        Mingliang Liu

        Issue Links

          Activity

          Hide
          cnauroth Chris Nauroth added a comment -

          HIVE-10223 is an example of an inefficient call pattern: multiple calls to the convenience wrapper methods that I was able to trivially consolidate down to a single getFileStatus.

          I believe the full set of these wrapper methods to deprecate are:

          FileSystem#exists
          FileSystem#getBlockSize
          FileSystem#getLength
          FileSystem#getReplication
          FileSystem#isDirectory
          FileSystem#isFile

          This issue does not apply to FileContext, where methods like exists can be placed behind FileContext.Util, which comes with JavaDocs describing that these are not primitive operations.

          Show
          cnauroth Chris Nauroth added a comment - HIVE-10223 is an example of an inefficient call pattern: multiple calls to the convenience wrapper methods that I was able to trivially consolidate down to a single getFileStatus . I believe the full set of these wrapper methods to deprecate are: FileSystem#exists FileSystem#getBlockSize FileSystem#getLength FileSystem#getReplication FileSystem#isDirectory FileSystem#isFile This issue does not apply to FileContext , where methods like exists can be placed behind FileContext.Util , which comes with JavaDocs describing that these are not primitive operations.
          Hide
          liuml07 Mingliang Liu added a comment -

          +1 (non-binding) for the proposal, and the set of the wrapper methods. After watching https://www.youtube.com/watch?v=R-BjP1iQ5lU I believe this is a necessary long term fix.

          Show
          liuml07 Mingliang Liu added a comment - +1 (non-binding) for the proposal, and the set of the wrapper methods. After watching https://www.youtube.com/watch?v=R-BjP1iQ5lU I believe this is a necessary long term fix.
          Hide
          stevel@apache.org Steve Loughran added a comment -

          I support this...though it'd need to be backed by an audit of downstream projects (hive, spark, hbase) to make sure they are moved on too

          Show
          stevel@apache.org Steve Loughran added a comment - I support this...though it'd need to be backed by an audit of downstream projects (hive, spark, hbase) to make sure they are moved on too
          Hide
          cnauroth Chris Nauroth added a comment -

          I support this...though it'd need to be backed by an audit of downstream projects (hive, spark, hbase) to make sure they are moved on too

          I think Hive and Pig are all set after I gave them a few patches a while ago, unless they added new code that called these methods. I also have this under way for Tez, ORC and Spark. I haven't looked at HBase yet, but I can add it to the list.

          Show
          cnauroth Chris Nauroth added a comment - I support this...though it'd need to be backed by an audit of downstream projects (hive, spark, hbase) to make sure they are moved on too I think Hive and Pig are all set after I gave them a few patches a while ago, unless they added new code that called these methods. I also have this under way for Tez, ORC and Spark. I haven't looked at HBase yet, but I can add it to the list.
          Hide
          liuml07 Mingliang Liu added a comment -

          The v0 patch is to deprecate those methods Chris Nauroth listed above.

          Show
          liuml07 Mingliang Liu added a comment - The v0 patch is to deprecate those methods Chris Nauroth listed above.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 22s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 mvninstall 7m 24s trunk passed
          +1 compile 6m 51s trunk passed
          +1 checkstyle 0m 24s trunk passed
          +1 mvnsite 0m 55s trunk passed
          +1 mvneclipse 0m 12s trunk passed
          +1 findbugs 1m 21s trunk passed
          +1 javadoc 0m 45s trunk passed
          +1 mvninstall 0m 36s the patch passed
          +1 compile 6m 50s the patch passed
          -1 javac 6m 50s root generated 1243 new + 711 unchanged - 0 fixed = 1954 total (was 711)
          +1 checkstyle 0m 27s the patch passed
          +1 mvnsite 0m 53s the patch passed
          +1 mvneclipse 0m 12s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 1m 26s the patch passed
          +1 javadoc 0m 44s the patch passed
          +1 unit 7m 56s hadoop-common in the patch passed.
          +1 asflicense 0m 21s The patch does not generate ASF License warnings.
          39m 12s



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:9560f25
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12818059/HADOOP-13321.000.patch
          JIRA Issue HADOOP-13321
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 0533553f676d 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / e549a9a
          Default Java 1.8.0_91
          findbugs v3.0.0
          javac https://builds.apache.org/job/PreCommit-HADOOP-Build/10006/artifact/patchprocess/diff-compile-javac-root.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10006/testReport/
          modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10006/console
          Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 22s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 7m 24s trunk passed +1 compile 6m 51s trunk passed +1 checkstyle 0m 24s trunk passed +1 mvnsite 0m 55s trunk passed +1 mvneclipse 0m 12s trunk passed +1 findbugs 1m 21s trunk passed +1 javadoc 0m 45s trunk passed +1 mvninstall 0m 36s the patch passed +1 compile 6m 50s the patch passed -1 javac 6m 50s root generated 1243 new + 711 unchanged - 0 fixed = 1954 total (was 711) +1 checkstyle 0m 27s the patch passed +1 mvnsite 0m 53s the patch passed +1 mvneclipse 0m 12s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 26s the patch passed +1 javadoc 0m 44s the patch passed +1 unit 7m 56s hadoop-common in the patch passed. +1 asflicense 0m 21s The patch does not generate ASF License warnings. 39m 12s Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12818059/HADOOP-13321.000.patch JIRA Issue HADOOP-13321 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 0533553f676d 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / e549a9a Default Java 1.8.0_91 findbugs v3.0.0 javac https://builds.apache.org/job/PreCommit-HADOOP-Build/10006/artifact/patchprocess/diff-compile-javac-root.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10006/testReport/ modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10006/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          cnauroth Chris Nauroth added a comment -

          Mingliang Liu, thank you for posting a patch. I am holding off reviewing and committing this while we do a bit more work throughout the ecosystem to eliminate some existing calls to these methods. I'll link relevant issues from all ecosystem projects here.

          Show
          cnauroth Chris Nauroth added a comment - Mingliang Liu , thank you for posting a patch. I am holding off reviewing and committing this while we do a bit more work throughout the ecosystem to eliminate some existing calls to these methods. I'll link relevant issues from all ecosystem projects here.
          Hide
          liuml07 Mingliang Liu added a comment -

          It makes perfect sense to me. Thanks for the effort, Chris Nauroth.

          Show
          liuml07 Mingliang Liu added a comment - It makes perfect sense to me. Thanks for the effort, Chris Nauroth .
          Hide
          stevel@apache.org Steve Loughran added a comment -

          +we need to take the high ground here and eliminate them internally before telling others off

          Show
          stevel@apache.org Steve Loughran added a comment - +we need to take the high ground here and eliminate them internally before telling others off
          Hide
          stevel@apache.org Steve Loughran added a comment -

          Having been through our own code, exists() is used in places where it would be really convoluted to replace it with getFileStatus and exception catching. We only really want to discourage it when used back to back with other get file status calls, or before an operation (delete, rename) which checks some of the same entities.

          If the FS client does some very short term caching, even a fraction of a second, the penalty of two back-to-back getFileStatus() checks would become zero ... that may be the way to go.

          Show
          stevel@apache.org Steve Loughran added a comment - Having been through our own code, exists() is used in places where it would be really convoluted to replace it with getFileStatus and exception catching. We only really want to discourage it when used back to back with other get file status calls, or before an operation (delete, rename) which checks some of the same entities. If the FS client does some very short term caching, even a fraction of a second, the penalty of two back-to-back getFileStatus() checks would become zero ... that may be the way to go.
          Hide
          cnauroth Chris Nauroth added a comment -

          Steve Loughran, are you suggesting that we don't in fact deprecate the APIs? I'd be comfortable with that if we mitigate in other ways, such as clear warnings in JavaDocs about the potential inefficiencies.

          If the FS client does some very short term caching, even a fraction of a second, the penalty of two back-to-back getFileStatus() checks would become zero ... that may be the way to go.

          Linking to HADOOP-12876, which tracks an implementation of this idea in Azure Data Lake. I'd like to explore refactoring that out to Hadoop Common for any file system to use.

          Show
          cnauroth Chris Nauroth added a comment - Steve Loughran , are you suggesting that we don't in fact deprecate the APIs? I'd be comfortable with that if we mitigate in other ways, such as clear warnings in JavaDocs about the potential inefficiencies. If the FS client does some very short term caching, even a fraction of a second, the penalty of two back-to-back getFileStatus() checks would become zero ... that may be the way to go. Linking to HADOOP-12876 , which tracks an implementation of this idea in Azure Data Lake. I'd like to explore refactoring that out to Hadoop Common for any file system to use.
          Hide
          stevel@apache.org Steve Loughran added a comment -

          I think we should leave exists() alone but deprecate the rest, because the others tend to be used differently

          Show
          stevel@apache.org Steve Loughran added a comment - I think we should leave exists() alone but deprecate the rest, because the others tend to be used differently
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 16s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 mvninstall 8m 7s trunk passed
          +1 compile 8m 36s trunk passed
          +1 checkstyle 0m 27s trunk passed
          +1 mvnsite 0m 59s trunk passed
          +1 mvneclipse 0m 13s trunk passed
          +1 findbugs 1m 33s trunk passed
          +1 javadoc 0m 47s trunk passed
          +1 mvninstall 0m 45s the patch passed
          +1 compile 8m 21s the patch passed
          -1 javac 8m 21s root generated 91 new + 710 unchanged - 0 fixed = 801 total (was 710)
          +1 checkstyle 0m 28s the patch passed
          +1 mvnsite 0m 55s the patch passed
          +1 mvneclipse 0m 15s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 1m 44s the patch passed
          +1 javadoc 0m 48s the patch passed
          +1 unit 9m 10s hadoop-common in the patch passed.
          +1 asflicense 0m 21s The patch does not generate ASF License warnings.
          45m 9s



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:9560f25
          JIRA Issue HADOOP-13321
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12825714/HADOOP-13321.001.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux fbeaba7c2a97 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 407b519
          Default Java 1.8.0_101
          findbugs v3.0.0
          javac https://builds.apache.org/job/PreCommit-HADOOP-Build/10386/artifact/patchprocess/diff-compile-javac-root.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10386/testReport/
          modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10386/console
          Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 16s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 8m 7s trunk passed +1 compile 8m 36s trunk passed +1 checkstyle 0m 27s trunk passed +1 mvnsite 0m 59s trunk passed +1 mvneclipse 0m 13s trunk passed +1 findbugs 1m 33s trunk passed +1 javadoc 0m 47s trunk passed +1 mvninstall 0m 45s the patch passed +1 compile 8m 21s the patch passed -1 javac 8m 21s root generated 91 new + 710 unchanged - 0 fixed = 801 total (was 710) +1 checkstyle 0m 28s the patch passed +1 mvnsite 0m 55s the patch passed +1 mvneclipse 0m 15s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 44s the patch passed +1 javadoc 0m 48s the patch passed +1 unit 9m 10s hadoop-common in the patch passed. +1 asflicense 0m 21s The patch does not generate ASF License warnings. 45m 9s Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue HADOOP-13321 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12825714/HADOOP-13321.001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux fbeaba7c2a97 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 407b519 Default Java 1.8.0_101 findbugs v3.0.0 javac https://builds.apache.org/job/PreCommit-HADOOP-Build/10386/artifact/patchprocess/diff-compile-javac-root.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10386/testReport/ modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10386/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s Docker mode activated.
          -1 docker 3m 53s Docker failed to build yetus/hadoop:a9ad5d6.



          Subsystem Report/Notes
          JIRA Issue HADOOP-13321
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12825714/HADOOP-13321.001.patch
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/11061/console
          Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. -1 docker 3m 53s Docker failed to build yetus/hadoop:a9ad5d6. Subsystem Report/Notes JIRA Issue HADOOP-13321 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12825714/HADOOP-13321.001.patch Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/11061/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          liuml07 Mingliang Liu added a comment -

          As HADOOP-13427 is committed, we have HADOOP, SPARK, HIVE, and PIG updated. I think we can get this patch in? Deprecation in trunk may be encouraging for other ecosystem projects we're not actively working on (say HBase, Tez etc).

          Ping Chris Nauroth and Steve Loughran

          Show
          liuml07 Mingliang Liu added a comment - As HADOOP-13427 is committed, we have HADOOP, SPARK, HIVE, and PIG updated. I think we can get this patch in? Deprecation in trunk may be encouraging for other ecosystem projects we're not actively working on (say HBase, Tez etc). Ping Chris Nauroth and Steve Loughran
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 14s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 mvninstall 6m 44s trunk passed
          +1 compile 9m 31s trunk passed
          +1 checkstyle 0m 29s trunk passed
          +1 mvnsite 1m 2s trunk passed
          +1 mvneclipse 0m 17s trunk passed
          +1 findbugs 1m 29s trunk passed
          +1 javadoc 0m 47s trunk passed
          +1 mvninstall 0m 38s the patch passed
          +1 compile 9m 27s the patch passed
          -1 javac 9m 27s root generated 89 new + 691 unchanged - 0 fixed = 780 total (was 691)
          +1 checkstyle 0m 29s the patch passed
          +1 mvnsite 1m 0s the patch passed
          +1 mvneclipse 0m 18s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 1m 35s the patch passed
          +1 javadoc 0m 49s the patch passed
          +1 unit 7m 53s hadoop-common in the patch passed.
          +1 asflicense 0m 32s The patch does not generate ASF License warnings.
          45m 2s



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:a9ad5d6
          JIRA Issue HADOOP-13321
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12825714/HADOOP-13321.001.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux cd5b3c910f9e 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12 17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / f121d0b
          Default Java 1.8.0_111
          findbugs v3.0.0
          javac https://builds.apache.org/job/PreCommit-HADOOP-Build/11072/artifact/patchprocess/diff-compile-javac-root.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/11072/testReport/
          modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/11072/console
          Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 14s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 6m 44s trunk passed +1 compile 9m 31s trunk passed +1 checkstyle 0m 29s trunk passed +1 mvnsite 1m 2s trunk passed +1 mvneclipse 0m 17s trunk passed +1 findbugs 1m 29s trunk passed +1 javadoc 0m 47s trunk passed +1 mvninstall 0m 38s the patch passed +1 compile 9m 27s the patch passed -1 javac 9m 27s root generated 89 new + 691 unchanged - 0 fixed = 780 total (was 691) +1 checkstyle 0m 29s the patch passed +1 mvnsite 1m 0s the patch passed +1 mvneclipse 0m 18s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 35s the patch passed +1 javadoc 0m 49s the patch passed +1 unit 7m 53s hadoop-common in the patch passed. +1 asflicense 0m 32s The patch does not generate ASF License warnings. 45m 2s Subsystem Report/Notes Docker Image:yetus/hadoop:a9ad5d6 JIRA Issue HADOOP-13321 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12825714/HADOOP-13321.001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux cd5b3c910f9e 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12 17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / f121d0b Default Java 1.8.0_111 findbugs v3.0.0 javac https://builds.apache.org/job/PreCommit-HADOOP-Build/11072/artifact/patchprocess/diff-compile-javac-root.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/11072/testReport/ modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/11072/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          stevel@apache.org Steve Loughran added a comment -

          +1 for this on trunk

          Show
          stevel@apache.org Steve Loughran added a comment - +1 for this on trunk
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s Docker mode activated.
          -1 patch 0m 6s HADOOP-13321 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.



          Subsystem Report/Notes
          JIRA Issue HADOOP-13321
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12825714/HADOOP-13321.001.patch
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/11644/console
          Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. -1 patch 0m 6s HADOOP-13321 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help. Subsystem Report/Notes JIRA Issue HADOOP-13321 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12825714/HADOOP-13321.001.patch Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/11644/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          stevel@apache.org Steve Loughran added a comment -

          patch doesn't apply any more im afraid, the javadoc improvements broke the diff. If you can resync and resubmit it, I'll review it again

          Show
          stevel@apache.org Steve Loughran added a comment - patch doesn't apply any more im afraid, the javadoc improvements broke the diff. If you can resync and resubmit it, I'll review it again
          Hide
          liuml07 Mingliang Liu added a comment -

          Thanks Steve Loughran for your review. I found some of the javadoc problems have been fixed by your previous patch. As we don't really honor the order of javadoc annotations, the v2 patch does not change the existing @deprecated annotation.

          Show
          liuml07 Mingliang Liu added a comment - Thanks Steve Loughran for your review. I found some of the javadoc problems have been fixed by your previous patch. As we don't really honor the order of javadoc annotations, the v2 patch does not change the existing @deprecated annotation.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 17s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 mvninstall 12m 26s trunk passed
          +1 compile 11m 44s trunk passed
          +1 checkstyle 0m 34s trunk passed
          +1 mvnsite 1m 2s trunk passed
          +1 mvneclipse 0m 18s trunk passed
          +1 findbugs 1m 25s trunk passed
          +1 javadoc 0m 48s trunk passed
          +1 mvninstall 0m 36s the patch passed
          +1 compile 10m 43s the patch passed
          -1 javac 10m 43s root generated 93 new + 702 unchanged - 0 fixed = 795 total (was 702)
          +1 checkstyle 0m 34s the patch passed
          +1 mvnsite 0m 58s the patch passed
          +1 mvneclipse 0m 18s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 1m 32s the patch passed
          +1 javadoc 0m 48s the patch passed
          -1 unit 8m 37s hadoop-common in the patch failed.
          +1 asflicense 0m 33s The patch does not generate ASF License warnings.
          55m 9s



          Reason Tests
          Failed junit tests hadoop.security.TestKDiag



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:a9ad5d6
          JIRA Issue HADOOP-13321
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12853171/HADOOP-13321.002.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 1cf8c4a6d9e4 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6 15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / f432999
          Default Java 1.8.0_121
          findbugs v3.0.0
          javac https://builds.apache.org/job/PreCommit-HADOOP-Build/11649/artifact/patchprocess/diff-compile-javac-root.txt
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/11649/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/11649/testReport/
          modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/11649/console
          Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 17s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 12m 26s trunk passed +1 compile 11m 44s trunk passed +1 checkstyle 0m 34s trunk passed +1 mvnsite 1m 2s trunk passed +1 mvneclipse 0m 18s trunk passed +1 findbugs 1m 25s trunk passed +1 javadoc 0m 48s trunk passed +1 mvninstall 0m 36s the patch passed +1 compile 10m 43s the patch passed -1 javac 10m 43s root generated 93 new + 702 unchanged - 0 fixed = 795 total (was 702) +1 checkstyle 0m 34s the patch passed +1 mvnsite 0m 58s the patch passed +1 mvneclipse 0m 18s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 32s the patch passed +1 javadoc 0m 48s the patch passed -1 unit 8m 37s hadoop-common in the patch failed. +1 asflicense 0m 33s The patch does not generate ASF License warnings. 55m 9s Reason Tests Failed junit tests hadoop.security.TestKDiag Subsystem Report/Notes Docker Image:yetus/hadoop:a9ad5d6 JIRA Issue HADOOP-13321 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12853171/HADOOP-13321.002.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 1cf8c4a6d9e4 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6 15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / f432999 Default Java 1.8.0_121 findbugs v3.0.0 javac https://builds.apache.org/job/PreCommit-HADOOP-Build/11649/artifact/patchprocess/diff-compile-javac-root.txt unit https://builds.apache.org/job/PreCommit-HADOOP-Build/11649/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/11649/testReport/ modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/11649/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          stevel@apache.org Steve Loughran added a comment -

          well, there's a lot more deprecation warnings coming out, but that's a good sign: it shows things are working. Once this is in, we could tune stuff.

          That said, I think for the production warnings in swift and s3a, we should add @SuppressWarnings(“deprecation”) annotations to their isDirectory/isFile subclassed methods, so that those ones don't raise false alarms.

          Show
          stevel@apache.org Steve Loughran added a comment - well, there's a lot more deprecation warnings coming out, but that's a good sign: it shows things are working. Once this is in, we could tune stuff. That said, I think for the production warnings in swift and s3a, we should add @SuppressWarnings(“deprecation”) annotations to their isDirectory/isFile subclassed methods, so that those ones don't raise false alarms.
          Hide
          liuml07 Mingliang Liu added a comment -

          Thanks Steve, the point is very valid. I changed the patch.

          Show
          liuml07 Mingliang Liu added a comment - Thanks Steve, the point is very valid. I changed the patch.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 23s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          0 mvndep 1m 51s Maven dependency ordering for branch
          +1 mvninstall 12m 39s trunk passed
          +1 compile 12m 52s trunk passed
          +1 checkstyle 1m 50s trunk passed
          +1 mvnsite 1m 49s trunk passed
          +1 mvneclipse 1m 1s trunk passed
          +1 findbugs 2m 40s trunk passed
          +1 javadoc 1m 28s trunk passed
          0 mvndep 0m 17s Maven dependency ordering for patch
          +1 mvninstall 1m 26s the patch passed
          +1 compile 12m 30s the patch passed
          -1 javac 12m 30s root generated 87 new + 707 unchanged - 0 fixed = 794 total (was 707)
          +1 checkstyle 1m 58s the patch passed
          +1 mvnsite 1m 56s the patch passed
          +1 mvneclipse 1m 7s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 3m 9s the patch passed
          +1 javadoc 1m 40s the patch passed
          -1 unit 8m 12s hadoop-common in the patch failed.
          +1 unit 0m 25s hadoop-openstack in the patch passed.
          +1 unit 0m 33s hadoop-aws in the patch passed.
          +1 asflicense 0m 38s The patch does not generate ASF License warnings.
          94m 51s



          Reason Tests
          Failed junit tests hadoop.security.TestKDiag



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:a9ad5d6
          JIRA Issue HADOOP-13321
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12853402/HADOOP-13321.003.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux e6aaf270e136 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6 15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / dbbfcf7
          Default Java 1.8.0_121
          findbugs v3.0.0
          javac https://builds.apache.org/job/PreCommit-HADOOP-Build/11654/artifact/patchprocess/diff-compile-javac-root.txt
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/11654/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/11654/testReport/
          modules C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-aws U: .
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/11654/console
          Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 23s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. 0 mvndep 1m 51s Maven dependency ordering for branch +1 mvninstall 12m 39s trunk passed +1 compile 12m 52s trunk passed +1 checkstyle 1m 50s trunk passed +1 mvnsite 1m 49s trunk passed +1 mvneclipse 1m 1s trunk passed +1 findbugs 2m 40s trunk passed +1 javadoc 1m 28s trunk passed 0 mvndep 0m 17s Maven dependency ordering for patch +1 mvninstall 1m 26s the patch passed +1 compile 12m 30s the patch passed -1 javac 12m 30s root generated 87 new + 707 unchanged - 0 fixed = 794 total (was 707) +1 checkstyle 1m 58s the patch passed +1 mvnsite 1m 56s the patch passed +1 mvneclipse 1m 7s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 3m 9s the patch passed +1 javadoc 1m 40s the patch passed -1 unit 8m 12s hadoop-common in the patch failed. +1 unit 0m 25s hadoop-openstack in the patch passed. +1 unit 0m 33s hadoop-aws in the patch passed. +1 asflicense 0m 38s The patch does not generate ASF License warnings. 94m 51s Reason Tests Failed junit tests hadoop.security.TestKDiag Subsystem Report/Notes Docker Image:yetus/hadoop:a9ad5d6 JIRA Issue HADOOP-13321 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12853402/HADOOP-13321.003.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux e6aaf270e136 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6 15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / dbbfcf7 Default Java 1.8.0_121 findbugs v3.0.0 javac https://builds.apache.org/job/PreCommit-HADOOP-Build/11654/artifact/patchprocess/diff-compile-javac-root.txt unit https://builds.apache.org/job/PreCommit-HADOOP-Build/11654/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/11654/testReport/ modules C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-aws U: . Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/11654/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          stevel@apache.org Steve Loughran added a comment -

          the marking up looks good. Could you do the same for FTPFileSystem. and ChecksumFileSystem? Once that's done I'll be +1

          I looked at one fo the tests TestFsShellCopy to see if we should be ignoring the tests there but no, some of the test are doing exactly what we don't want: exists, isFile, listFileStatus calls...marking them as deprecated shows up where we have work to do in future.

          Show
          stevel@apache.org Steve Loughran added a comment - the marking up looks good. Could you do the same for FTPFileSystem. and ChecksumFileSystem ? Once that's done I'll be +1 I looked at one fo the tests TestFsShellCopy to see if we should be ignoring the tests there but no, some of the test are doing exactly what we don't want: exists, isFile, listFileStatus calls...marking them as deprecated shows up where we have work to do in future.
          Hide
          liuml07 Mingliang Liu added a comment -

          Thanks Steve!

          I filed HADOOP-14106 for tracking the effort of fixing the deprecated calls in UT.

          Show
          liuml07 Mingliang Liu added a comment - Thanks Steve! I filed HADOOP-14106 for tracking the effort of fixing the deprecated calls in UT.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 16s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          0 mvndep 1m 56s Maven dependency ordering for branch
          +1 mvninstall 13m 55s trunk passed
          +1 compile 12m 59s trunk passed
          +1 checkstyle 1m 54s trunk passed
          +1 mvnsite 1m 50s trunk passed
          +1 mvneclipse 0m 59s trunk passed
          +1 findbugs 2m 31s trunk passed
          +1 javadoc 1m 32s trunk passed
          0 mvndep 0m 16s Maven dependency ordering for patch
          +1 mvninstall 1m 14s the patch passed
          +1 compile 11m 3s the patch passed
          -1 javac 11m 3s root generated 83 new + 707 unchanged - 0 fixed = 790 total (was 707)
          +1 checkstyle 3m 20s the patch passed
          +1 mvnsite 2m 7s the patch passed
          +1 mvneclipse 1m 19s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 3m 6s the patch passed
          +1 javadoc 1m 42s the patch passed
          -1 unit 9m 6s hadoop-common in the patch failed.
          +1 unit 0m 25s hadoop-openstack in the patch passed.
          +1 unit 0m 35s hadoop-aws in the patch passed.
          +1 asflicense 0m 40s The patch does not generate ASF License warnings.
          97m 34s



          Reason Tests
          Failed junit tests hadoop.security.TestKDiag



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:a9ad5d6
          JIRA Issue HADOOP-13321
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12854084/HADOOP-13321.004.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 37989d498cf2 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6 15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 0013090
          Default Java 1.8.0_121
          findbugs v3.0.0
          javac https://builds.apache.org/job/PreCommit-HADOOP-Build/11691/artifact/patchprocess/diff-compile-javac-root.txt
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/11691/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/11691/testReport/
          modules C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-aws U: .
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/11691/console
          Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 16s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. 0 mvndep 1m 56s Maven dependency ordering for branch +1 mvninstall 13m 55s trunk passed +1 compile 12m 59s trunk passed +1 checkstyle 1m 54s trunk passed +1 mvnsite 1m 50s trunk passed +1 mvneclipse 0m 59s trunk passed +1 findbugs 2m 31s trunk passed +1 javadoc 1m 32s trunk passed 0 mvndep 0m 16s Maven dependency ordering for patch +1 mvninstall 1m 14s the patch passed +1 compile 11m 3s the patch passed -1 javac 11m 3s root generated 83 new + 707 unchanged - 0 fixed = 790 total (was 707) +1 checkstyle 3m 20s the patch passed +1 mvnsite 2m 7s the patch passed +1 mvneclipse 1m 19s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 3m 6s the patch passed +1 javadoc 1m 42s the patch passed -1 unit 9m 6s hadoop-common in the patch failed. +1 unit 0m 25s hadoop-openstack in the patch passed. +1 unit 0m 35s hadoop-aws in the patch passed. +1 asflicense 0m 40s The patch does not generate ASF License warnings. 97m 34s Reason Tests Failed junit tests hadoop.security.TestKDiag Subsystem Report/Notes Docker Image:yetus/hadoop:a9ad5d6 JIRA Issue HADOOP-13321 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12854084/HADOOP-13321.004.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 37989d498cf2 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6 15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 0013090 Default Java 1.8.0_121 findbugs v3.0.0 javac https://builds.apache.org/job/PreCommit-HADOOP-Build/11691/artifact/patchprocess/diff-compile-javac-root.txt unit https://builds.apache.org/job/PreCommit-HADOOP-Build/11691/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/11691/testReport/ modules C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-openstack hadoop-tools/hadoop-aws U: . Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/11691/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          liuml07 Mingliang Liu added a comment -

          Steve do you need another review?

          Show
          liuml07 Mingliang Liu added a comment - Steve do you need another review?
          Hide
          stevel@apache.org Steve Loughran added a comment -

          LGTM; all uses are now down in the tests, where you've filed a separate JIRA

          +1

          Show
          stevel@apache.org Steve Loughran added a comment - LGTM; all uses are now down in the tests, where you've filed a separate JIRA +1
          Hide
          liuml07 Mingliang Liu added a comment -

          Committed to trunk branch. Thanks Steve Loughran and Chris Nauroth for your help.

          Show
          liuml07 Mingliang Liu added a comment - Committed to trunk branch. Thanks Steve Loughran and Chris Nauroth for your help.
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11294 (See https://builds.apache.org/job/Hadoop-trunk-Commit/11294/)
          HADOOP-13321. Deprecate FileSystem APIs that promote inefficient call (liuml07: rev a4d4a23785356e6a19d0db3a2dec8ae8cf861273)

          • (edit) hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java
          • (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ChecksumFileSystem.java
          • (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ftp/FTPFileSystem.java
          • (edit) hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/snative/SwiftNativeFileSystem.java
          • (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11294 (See https://builds.apache.org/job/Hadoop-trunk-Commit/11294/ ) HADOOP-13321 . Deprecate FileSystem APIs that promote inefficient call (liuml07: rev a4d4a23785356e6a19d0db3a2dec8ae8cf861273) (edit) hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ChecksumFileSystem.java (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ftp/FTPFileSystem.java (edit) hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/snative/SwiftNativeFileSystem.java (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java

            People

            • Assignee:
              liuml07 Mingliang Liu
              Reporter:
              cnauroth Chris Nauroth
            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development