Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: webhdfs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      WebHDFS should be able to accept OAuth2 credentials.

      1. HDFS-8155-1.patch
        61 kB
        Jakob Homan
      2. HDFS-8155.006.patch
        62 kB
        Jakob Homan
      3. HDFS-8155.005.patch
        62 kB
        Jakob Homan
      4. HDFS-8155.004.patch
        62 kB
        Jakob Homan
      5. HDFS-8155.003.patch
        62 kB
        Jakob Homan
      6. HDFS-8155.002.patch
        59 kB
        Jakob Homan

        Issue Links

          Activity

          Hide
          jghoman Jakob Homan added a comment -

          After HDFS-8154, it will be much easier for other backends than Hadoop to offer access via the WebHDFS specification. In this environment, it would be good to support more types of authentication, even if Hadoop itself does not immediately support it. OAuth2 would be a good candidate. We should amend the WebHDFS spec to support OAuth tokens, specifically by providing either bearer/refresh tokens in the config (RFC 4.1, with the allowance that the tokens have already been obtained to obviate the need for user interaction), or via a credential that can be exchanged for those tokens (RFC 4.3).
          This would allow a WebHDFS backed to support either OAuth2 or SPENGO. WebHDFS backends (including Hadoop) would only be expected to support one type of authentication per system and would be able to reject calls made using another type.
          Under this proposal, post HDFS-8154, the WebHDFSFileSystem will need to be updated to support presenting OAuth credentials, but it is not necessary to modify the Namenode or Datanodes to accept them. That can be done as part of HADOOP-11744.

          Show
          jghoman Jakob Homan added a comment - After HDFS-8154 , it will be much easier for other backends than Hadoop to offer access via the WebHDFS specification. In this environment, it would be good to support more types of authentication, even if Hadoop itself does not immediately support it. OAuth2 would be a good candidate. We should amend the WebHDFS spec to support OAuth tokens, specifically by providing either bearer/refresh tokens in the config ( RFC 4.1 , with the allowance that the tokens have already been obtained to obviate the need for user interaction), or via a credential that can be exchanged for those tokens ( RFC 4.3 ). This would allow a WebHDFS backed to support either OAuth2 or SPENGO. WebHDFS backends (including Hadoop) would only be expected to support one type of authentication per system and would be able to reject calls made using another type. Under this proposal, post HDFS-8154 , the WebHDFSFileSystem will need to be updated to support presenting OAuth credentials, but it is not necessary to modify the Namenode or Datanodes to accept them. That can be done as part of HADOOP-11744 .
          Hide
          drankye Kai Zheng added a comment -

          Hello Jakob Homan,

          Thanks for having this and the good thought. We're working on HADOOP-11817, where both JWT token and OAuth2 token are to be supported for Hadoop web thru a generic token representation and API by pluggable approach. We use CloudFoundry for the OAuth2 test. We'll post our initial patch in this week and I hope our work can meet with your need. We would be glad to help with the web HDFS case, would you mind our side working on this issue as well? We would definitely welcome your thoughts, ideas and reviews, considering your concrete OAuth2 token provider and cases. Thanks.

          Show
          drankye Kai Zheng added a comment - Hello Jakob Homan , Thanks for having this and the good thought. We're working on HADOOP-11817 , where both JWT token and OAuth2 token are to be supported for Hadoop web thru a generic token representation and API by pluggable approach. We use CloudFoundry for the OAuth2 test. We'll post our initial patch in this week and I hope our work can meet with your need. We would be glad to help with the web HDFS case, would you mind our side working on this issue as well? We would definitely welcome your thoughts, ideas and reviews, considering your concrete OAuth2 token provider and cases. Thanks.
          Hide
          drankye Kai Zheng added a comment -

          Thanks a lot for reporting the JIRA. I have plans for working on OAuth2 and implementing the WebHDFS case, so I am taking this JIRA. Initial patches and design draft will be uploaded to HADOOP-11766 in this week or early next week, please help review and comment then. Thanks.

          Show
          drankye Kai Zheng added a comment - Thanks a lot for reporting the JIRA. I have plans for working on OAuth2 and implementing the WebHDFS case, so I am taking this JIRA. Initial patches and design draft will be uploaded to HADOOP-11766 in this week or early next week, please help review and comment then. Thanks.
          Hide
          drankye Kai Zheng added a comment -

          Jakob Homan,

          I noticed this issue was linked to HDFS-8154 as depended. Would you provide your rational? I thought the OAuth2 support for Web HDFS can be done separately like we would do for Hadoop Web UI, or you mean more than that? Thanks.

          Show
          drankye Kai Zheng added a comment - Jakob Homan , I noticed this issue was linked to HDFS-8154 as depended. Would you provide your rational? I thought the OAuth2 support for Web HDFS can be done separately like we would do for Hadoop Web UI, or you mean more than that? Thanks.
          Hide
          jghoman Jakob Homan added a comment -

          Hey Kai-
          This JIRA is part of the larger effort of 8154 to make the WebHDFS REST specification more general and accessible to other clients and back-end implementations. It will likely build on your work to add OAuth2 throughout the system.

          Effectively, this JIRA is for two items: a) add OAuth2 as a possible authentication method (along with SPENGO, simple and delegation tokens) and b) add support in the WebHDFSFileSystem for passing OAuth tokens (or obtaining those tokens via configuration-supplied credentials or user/name password) to the WebHDFS backend. I'm interested in the client and non-Namenode WebHDFS backends, while you're focusing on the Namenode and other current components.

          I would like to get the change to the WebHDFS spec and support on the client in soon. Happy to use your code, or to commit it if it's ready.

          Show
          jghoman Jakob Homan added a comment - Hey Kai- This JIRA is part of the larger effort of 8154 to make the WebHDFS REST specification more general and accessible to other clients and back-end implementations. It will likely build on your work to add OAuth2 throughout the system. Effectively, this JIRA is for two items: a) add OAuth2 as a possible authentication method (along with SPENGO, simple and delegation tokens) and b) add support in the WebHDFSFileSystem for passing OAuth tokens (or obtaining those tokens via configuration-supplied credentials or user/name password) to the WebHDFS backend. I'm interested in the client and non-Namenode WebHDFS backends, while you're focusing on the Namenode and other current components. I would like to get the change to the WebHDFS spec and support on the client in soon. Happy to use your code, or to commit it if it's ready.
          Hide
          wheat9 Haohui Mai added a comment -

          I think that there are two use cases here:

          • Using WebHDFS in UI
          • Using WebHDFS programmatically (e.g., through WebHdfsFileSystem)

          For the first use case – WebHDFS now recognizes the auth cookie of the UI therefore the UI works as long as any third-party filter behaves correctly w.r.t. the UI pages.

          For the second use case – WebHDFS is designed to use DT as the authentication method. To authenticate, the third-party filter (OAuth2 filter included) should control when to issue a DT when getting the GETDELEGATIONTOKEN call. The DT needs to be presented to the server in all subsequent usages.

          I don't think injecting any third-party payload (e.g., OAuth tokens) into WebHdfsFileSystem make sense.

          Show
          wheat9 Haohui Mai added a comment - I think that there are two use cases here: Using WebHDFS in UI Using WebHDFS programmatically (e.g., through WebHdfsFileSystem ) For the first use case – WebHDFS now recognizes the auth cookie of the UI therefore the UI works as long as any third-party filter behaves correctly w.r.t. the UI pages. For the second use case – WebHDFS is designed to use DT as the authentication method. To authenticate, the third-party filter (OAuth2 filter included) should control when to issue a DT when getting the GETDELEGATIONTOKEN call. The DT needs to be presented to the server in all subsequent usages. I don't think injecting any third-party payload (e.g., OAuth tokens) into WebHdfsFileSystem make sense.
          Hide
          jghoman Jakob Homan added a comment -

          For the first use case – WebHDFS now recognizes the auth cookie of the UI therefore the UI works as long as any third-party filter behaves correctly w.r.t. the UI pages.

          I agree. I'm not considering UI right now.

          For the second use case – WebHDFS is designed to use DT as the authentication method.

          WebHDFS supports three distinct types of authentication: SPENGO, simple, delegation token.

          Please consider JIRA in light of the linked JIRA, HDFS-8154, which is going to extract WebHDFS as a separate interface that other backing stores will support. Currently the only way for some backing store to gain access to the Hadoop ecosystem is to implement oah.FileSystem, which would give it access to JVM based frameworks (Pig, Hive, Spark, etc.). Additionally, such a store may wish to expose a REST interface to itself or provide easy access to non-JVM systems. Such a system could go about defining a REST specification into the oah.FileSystem, but that definition would look exactly (or pretty much) like what WebHDFS already defines. Instead of such duplication, HDFS-8154 looks to make what we already have (WebHDFS) more general and useful. As part of that, we need to add support for a more widely used authorization system, OAuth2.

          An important point is that WebHDFS is misnamed:

          WebHDFSFileSystem.java
          public class WebHdfsFileSystem extends FileSystem
              implements DelegationTokenRenewer.Renewable, TokenAspect.TokenManagementDelegator {
          

          WebHDFS extends FileSystem, not DistributedFileSystem and so should properly be called WebFileSystem. As such, the general purpose methods that it implements (and its REST endpoints expose) are suitable for implementation for lots of backing stores. HDFS-8154 and this JIRA are about making that extensibility explicit and easy.

          To authenticate, the third-party filter (OAuth2 filter included) should control when to issue a DT when getting the GETDELEGATIONTOKEN call. The DT needs to be presented to the server in all subsequent usages.

          Not all file systems issue delegation tokens, so it should not be a requirement for WebHDFS-backed systems to either. Instead, OAuth2 credentials (generic credentials per RFC spec section 4.3, explicit bearer/refresh tokens, or even maybe plaintext password/usernames) should be able to be provided and passed into whatever framework is actually handling the negotiation (ie, the filters).

          I don't think injecting any third-party payload (e.g., OAuth tokens) into WebHdfsFileSystem make sense.

          SPNEGO is already a third-party payload. This JIRA only adds OAuth as another option.

          Show
          jghoman Jakob Homan added a comment - For the first use case – WebHDFS now recognizes the auth cookie of the UI therefore the UI works as long as any third-party filter behaves correctly w.r.t. the UI pages. I agree. I'm not considering UI right now. For the second use case – WebHDFS is designed to use DT as the authentication method. WebHDFS supports three distinct types of authentication : SPENGO, simple, delegation token. Please consider JIRA in light of the linked JIRA, HDFS-8154 , which is going to extract WebHDFS as a separate interface that other backing stores will support. Currently the only way for some backing store to gain access to the Hadoop ecosystem is to implement oah.FileSystem, which would give it access to JVM based frameworks (Pig, Hive, Spark, etc.). Additionally, such a store may wish to expose a REST interface to itself or provide easy access to non-JVM systems. Such a system could go about defining a REST specification into the oah.FileSystem, but that definition would look exactly (or pretty much) like what WebHDFS already defines. Instead of such duplication, HDFS-8154 looks to make what we already have (WebHDFS) more general and useful. As part of that, we need to add support for a more widely used authorization system, OAuth2. An important point is that WebHDFS is misnamed: WebHDFSFileSystem.java public class WebHdfsFileSystem extends FileSystem implements DelegationTokenRenewer.Renewable, TokenAspect.TokenManagementDelegator { WebHDFS extends FileSystem, not DistributedFileSystem and so should properly be called WebFileSystem. As such, the general purpose methods that it implements (and its REST endpoints expose) are suitable for implementation for lots of backing stores. HDFS-8154 and this JIRA are about making that extensibility explicit and easy. To authenticate, the third-party filter (OAuth2 filter included) should control when to issue a DT when getting the GETDELEGATIONTOKEN call. The DT needs to be presented to the server in all subsequent usages. Not all file systems issue delegation tokens, so it should not be a requirement for WebHDFS-backed systems to either. Instead, OAuth2 credentials (generic credentials per RFC spec section 4.3, explicit bearer/refresh tokens, or even maybe plaintext password/usernames) should be able to be provided and passed into whatever framework is actually handling the negotiation (ie, the filters). I don't think injecting any third-party payload (e.g., OAuth tokens) into WebHdfsFileSystem make sense. SPNEGO is already a third-party payload. This JIRA only adds OAuth as another option.
          Hide
          drankye Kai Zheng added a comment -

          Hi Jakob Homan,

          We should amend the WebHDFS spec to support OAuth tokens, specifically by providing either bearer/refresh tokens in the config (RFC 4.1, with the allowance that the tokens have already been obtained to obviate the need for user interaction), or via a credential that can be exchanged for those tokens (RFC 4.3).

          I understand you're externalizing and defining a generic WebHDFS interface and spec for more backend stores other than just HDFS. That looks great to me. As you may use Swagger or RAML to define the REST interface and generate the spec doc accordingly, I'm not yet sure if we need to couple with OAuth2 stuff with it, or how tightly if we have to. We have already support Simple, SPNEGO and DT, how they existing methods would be defined in your spec? I would take a look. In HADOOP-11766 we're working on a generic token support for Hadoop, based on it and a general token representation or API AuthToken would have the OAuth2 token support. We're going this way because there may different OAuth2 token providers and corresponding specifics. Simply saying, in places in Hadoop codes that uses a token (say OAuth2 token), it would use the AuthToken type, and the real AuthToken implementations, corresponding token decoders and validators are pluggable and configurable. In this way it would be possible to support more tokens (like JWT token), more OAuth2 providers, avoiding to change the basic thing. How would you think this approach? I thought we should avoid coupling with OAuth2 credentials tightly. Will it work in your side to add another method like TokenAuth for the general token support in your case and plugin the OAuth2 specific things? We're working on the design and maybe you could review it then have the confirm. Thanks.

          Show
          drankye Kai Zheng added a comment - Hi Jakob Homan , We should amend the WebHDFS spec to support OAuth tokens, specifically by providing either bearer/refresh tokens in the config (RFC 4.1, with the allowance that the tokens have already been obtained to obviate the need for user interaction), or via a credential that can be exchanged for those tokens (RFC 4.3). I understand you're externalizing and defining a generic WebHDFS interface and spec for more backend stores other than just HDFS. That looks great to me. As you may use Swagger or RAML to define the REST interface and generate the spec doc accordingly, I'm not yet sure if we need to couple with OAuth2 stuff with it, or how tightly if we have to. We have already support Simple, SPNEGO and DT, how they existing methods would be defined in your spec? I would take a look. In HADOOP-11766 we're working on a generic token support for Hadoop, based on it and a general token representation or API AuthToken would have the OAuth2 token support. We're going this way because there may different OAuth2 token providers and corresponding specifics. Simply saying, in places in Hadoop codes that uses a token (say OAuth2 token), it would use the AuthToken type, and the real AuthToken implementations, corresponding token decoders and validators are pluggable and configurable. In this way it would be possible to support more tokens (like JWT token), more OAuth2 providers, avoiding to change the basic thing. How would you think this approach? I thought we should avoid coupling with OAuth2 credentials tightly. Will it work in your side to add another method like TokenAuth for the general token support in your case and plugin the OAuth2 specific things? We're working on the design and maybe you could review it then have the confirm. Thanks.
          Hide
          drankye Kai Zheng added a comment -

          I'm interested in the client and non-Namenode WebHDFS backends, while you're focusing on the Namenode and other current components.

          Yeah right. So will your codes for the client and non-NameNode backends committed in Hadoop codebase? We're mainly focusing on HDFS and YARN initially for the token support as we're working on Hadoop. I thought in some time we may need to break down or re purpose this issue accordingly so we two sides could focus on different aspects, though both related to WebHDFS.

          Show
          drankye Kai Zheng added a comment - I'm interested in the client and non-Namenode WebHDFS backends, while you're focusing on the Namenode and other current components. Yeah right. So will your codes for the client and non-NameNode backends committed in Hadoop codebase? We're mainly focusing on HDFS and YARN initially for the token support as we're working on Hadoop. I thought in some time we may need to break down or re purpose this issue accordingly so we two sides could focus on different aspects, though both related to WebHDFS.
          Hide
          drankye Kai Zheng added a comment -

          Hey Haohui Mai,

          Thanks for your comment about the two cases and explanation about the second case for WebHDFS. I agree when an initial authentication like Kerberos/SPNEGO is passed, a DT will need to be generated and passed to the server in all subsequent usages.

          I don't think injecting any third-party payload (e.g., OAuth tokens) into WebHdfsFileSystem make sense.

          How about using a generic token representation and type? In HADOOP-11817 we're working on a new authentication handler for the generic token support for Hadoop Web UI and WebHDFS as well. It could be used with the AuthFilter in WebHDFS. Will it work in your point of view? Thanks.

          Show
          drankye Kai Zheng added a comment - Hey Haohui Mai , Thanks for your comment about the two cases and explanation about the second case for WebHDFS. I agree when an initial authentication like Kerberos/SPNEGO is passed, a DT will need to be generated and passed to the server in all subsequent usages. I don't think injecting any third-party payload (e.g., OAuth tokens) into WebHdfsFileSystem make sense. How about using a generic token representation and type? In HADOOP-11817 we're working on a new authentication handler for the generic token support for Hadoop Web UI and WebHDFS as well. It could be used with the AuthFilter in WebHDFS. Will it work in your point of view? Thanks.
          Hide
          jghoman Jakob Homan added a comment -

          I agree when an initial authentication like Kerberos/SPNEGO is passed, a DT will need to be generated and passed to the server in all subsequent usages.

          Why would it need to be? A backing store could accept a delegation token, or the datanodes could continue to accept the SPENGO/Kerberos credentials or OAuth tokens. DTs are one option, but I do not want to rule out datanodes/datanode-like-servers accepting standard credentials.

          Show
          jghoman Jakob Homan added a comment - I agree when an initial authentication like Kerberos/SPNEGO is passed, a DT will need to be generated and passed to the server in all subsequent usages. Why would it need to be? A backing store could accept a delegation token, or the datanodes could continue to accept the SPENGO/Kerberos credentials or OAuth tokens. DTs are one option, but I do not want to rule out datanodes/datanode-like-servers accepting standard credentials.
          Hide
          jghoman Jakob Homan added a comment -

          First patch for review. We've been testing a version of this code for a few months and it's working well.

          Two types of OAuth code grants (client credentials and refresh/access tokens provided by the conf) are supported by default and other code grants are user implementable. I had planned on using Apache Oltu for this, but that project doesn't seem very active and it's main benefit - special case support for oauth2 providers like github/twitter/fb, etc. - is of marginal benefit for WebHDFS and could easily be implemented by the user if necessary.

          I didn't end up using the Authenticator client class because it's too closely tied to the spnego implementation, but after this goes in it will be a good idea to make that class more generic and use it for the oauth stuff as well.

          Show
          jghoman Jakob Homan added a comment - First patch for review. We've been testing a version of this code for a few months and it's working well. Two types of OAuth code grants (client credentials and refresh/access tokens provided by the conf) are supported by default and other code grants are user implementable. I had planned on using Apache Oltu for this, but that project doesn't seem very active and it's main benefit - special case support for oauth2 providers like github/twitter/fb, etc. - is of marginal benefit for WebHDFS and could easily be implemented by the user if necessary. I didn't end up using the Authenticator client class because it's too closely tied to the spnego implementation, but after this goes in it will be a good idea to make that class more generic and use it for the oauth stuff as well.
          Hide
          chris.douglas Chris Douglas added a comment -

          Minor points; someone should look at the OAuth changes specifically.

          • Instead of adding its own Time classes under utils, it may make sense to move Clock from YARN to Common. Or use the Timer class in Common, if that's sufficient.
          • If the timing classes could use existing code, the Utils class could be package-private in o.a.h.hdfs.web.oauth2
          • Please add scope/visibility annotations to classes
          • The protected, mutable fields in the AccessTokenProvider classes can be private. nextRefreshMSSinceEpoch in Timer, also (constructor should explicitly init to 0 instead of self-ref)
          • Instead of requiring initialize, would it make sense for AccessTokenProvider implementations to implement Configurable as appropriate?
          • What is the expectation for multithreaded access for these classes?
          • If AccessTokenProvider were an abstract class, could the impls share more of the code in refresh? Superficially, they look very similar...
          • Should refresh throw IOException instead of IllegalArgumentException, since AccessTokenProvider::getAccessToken supports it?
          Show
          chris.douglas Chris Douglas added a comment - Minor points; someone should look at the OAuth changes specifically. Instead of adding its own Time classes under utils, it may make sense to move Clock from YARN to Common. Or use the Timer class in Common, if that's sufficient. If the timing classes could use existing code, the Utils class could be package-private in o.a.h.hdfs.web.oauth2 Please add scope/visibility annotations to classes The protected, mutable fields in the AccessTokenProvider classes can be private. nextRefreshMSSinceEpoch in Timer , also (constructor should explicitly init to 0 instead of self-ref) Instead of requiring initialize , would it make sense for AccessTokenProvider implementations to implement Configurable as appropriate? What is the expectation for multithreaded access for these classes? If AccessTokenProvider were an abstract class, could the impls share more of the code in refresh? Superficially, they look very similar... Should refresh throw IOException instead of IllegalArgumentException , since AccessTokenProvider::getAccessToken supports it?
          Hide
          jghoman Jakob Homan added a comment -

          Revised patch based on ChrisD's comments. Still applies to trunk and branch-2.

          Instead of adding its own Time classes under utils, it may make sense to move Clock from YARN to Common. Or use the Timer class in Common, if that's sufficient.

          Done. The Clock in YARN is public stable so can't be moved. There are about six other clocks or timers floating around. I picked the most useful and public in common.

          If the timing classes could use existing code, the Utils class could be package-private in o.a.h.hdfs.web.oauth2

          Done. They did and disappeared. I ended up moving the AccessTokenTimer out of utils package, which caused that package to vanish in a puff of smoke. Utils is now pp.

          Please add scope/visibility annotations to classes

          Done.

          The protected, mutable fields in the AccessTokenProvider classes can be private. nextRefreshMSSinceEpoch in Timer, also (constructor should explicitly init to 0 instead of self-ref)

          Done.

          Instead of requiring initialize, would it make sense for AccessTokenProvider implementations to implement Configurable as appropriate?

          Done. There's quite a lot going on in setConf, but oh well.

          What is the expectation for multithreaded access for these classes?

          Individual implementations should do the appropriate needful. For the two provided ones I've synchronized on the refresh method, which should work.

          If AccessTokenProvider were an abstract class, could the impls share more of the code in refresh? Superficially, they look very similar...

          I've gone back and forth on how much to share. I'd like to leave them a bit separate for now and see how many other implementations are provided and common they are. Since the code is public/evolving, it will work to update things as necessary. As part of the Configurable change, the class did became abstract rather than an interface, which will make changes in the future easier.

          Should refresh throw IOException instead of IllegalArgumentException, since AccessTokenProvider::getAccessToken supports it?

          Done.

          Show
          jghoman Jakob Homan added a comment - Revised patch based on ChrisD's comments. Still applies to trunk and branch-2. Instead of adding its own Time classes under utils, it may make sense to move Clock from YARN to Common. Or use the Timer class in Common, if that's sufficient. Done. The Clock in YARN is public stable so can't be moved. There are about six other clocks or timers floating around. I picked the most useful and public in common. If the timing classes could use existing code, the Utils class could be package-private in o.a.h.hdfs.web.oauth2 Done. They did and disappeared. I ended up moving the AccessTokenTimer out of utils package, which caused that package to vanish in a puff of smoke. Utils is now pp. Please add scope/visibility annotations to classes Done. The protected, mutable fields in the AccessTokenProvider classes can be private. nextRefreshMSSinceEpoch in Timer, also (constructor should explicitly init to 0 instead of self-ref) Done. Instead of requiring initialize, would it make sense for AccessTokenProvider implementations to implement Configurable as appropriate? Done. There's quite a lot going on in setConf, but oh well. What is the expectation for multithreaded access for these classes? Individual implementations should do the appropriate needful. For the two provided ones I've synchronized on the refresh method, which should work. If AccessTokenProvider were an abstract class, could the impls share more of the code in refresh? Superficially, they look very similar... I've gone back and forth on how much to share. I'd like to leave them a bit separate for now and see how many other implementations are provided and common they are. Since the code is public/evolving, it will work to update things as necessary. As part of the Configurable change, the class did became abstract rather than an interface, which will make changes in the future easier. Should refresh throw IOException instead of IllegalArgumentException, since AccessTokenProvider::getAccessToken supports it? Done.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          -1 pre-patch 22m 16s Pre-patch trunk has 4 extant Findbugs (version 3.0.0) warnings.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 4 new or modified test files.
          -1 javac 7m 50s The applied patch generated 2 additional warning messages.
          +1 javadoc 9m 59s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          +1 site 3m 3s Site still builds.
          -1 checkstyle 2m 40s The applied patch generated 36 new checkstyle issues (total was 151, now 187).
          -1 whitespace 0m 1s The patch has 7 line(s) that end in whitespace. Use git apply --whitespace=fix.
          +1 install 1m 30s mvn install still works.
          +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
          +1 findbugs 4m 21s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 native 3m 10s Pre-build of native portion
          +1 hdfs tests 163m 36s Tests passed in hadoop-hdfs.
          +1 hdfs tests 0m 27s Tests passed in hadoop-hdfs-client.
              219m 54s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12752142/HDFS-8155.002.patch
          Optional Tests javadoc javac unit findbugs checkstyle site
          git revision trunk / 57c7ae1
          Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12106/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html
          Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12106/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs-client.html
          javac https://builds.apache.org/job/PreCommit-HDFS-Build/12106/artifact/patchprocess/diffJavacWarnings.txt
          checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/12106/artifact/patchprocess/diffcheckstylehadoop-hdfs-client.txt
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12106/artifact/patchprocess/whitespace.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12106/artifact/patchprocess/testrun_hadoop-hdfs.txt
          hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12106/artifact/patchprocess/testrun_hadoop-hdfs-client.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12106/testReport/
          Java 1.7.0_55
          uname Linux asf908.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12106/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 pre-patch 22m 16s Pre-patch trunk has 4 extant Findbugs (version 3.0.0) warnings. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 4 new or modified test files. -1 javac 7m 50s The applied patch generated 2 additional warning messages. +1 javadoc 9m 59s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 site 3m 3s Site still builds. -1 checkstyle 2m 40s The applied patch generated 36 new checkstyle issues (total was 151, now 187). -1 whitespace 0m 1s The patch has 7 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 install 1m 30s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 4m 21s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 10s Pre-build of native portion +1 hdfs tests 163m 36s Tests passed in hadoop-hdfs. +1 hdfs tests 0m 27s Tests passed in hadoop-hdfs-client.     219m 54s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12752142/HDFS-8155.002.patch Optional Tests javadoc javac unit findbugs checkstyle site git revision trunk / 57c7ae1 Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12106/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12106/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs-client.html javac https://builds.apache.org/job/PreCommit-HDFS-Build/12106/artifact/patchprocess/diffJavacWarnings.txt checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/12106/artifact/patchprocess/diffcheckstylehadoop-hdfs-client.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12106/artifact/patchprocess/whitespace.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12106/artifact/patchprocess/testrun_hadoop-hdfs.txt hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12106/artifact/patchprocess/testrun_hadoop-hdfs-client.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12106/testReport/ Java 1.7.0_55 uname Linux asf908.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12106/console This message was automatically generated.
          Hide
          cnauroth Chris Nauroth added a comment -

          Hi Jakob Homan. Nice work! I have a few comments.

          1. ConfRefreshTokenBasedAccessTokenProvider, ConfRefreshTokenBasedAccessTokenProvider: There are no timeouts specified in the calls to the refresh URL. Timeouts can be controlled by calling client.setConnectTimeout and client.setReadTimeout.
          2. AccessTokenProvider: Optional - consider extending Configured so that it inherits the implementations of getConf and setConf for free.
          3. WebHDFS.md: Typo: "toekns" instead of "tokens"
          4. Please address the javac and checkstyle warnings.

          Chris Douglas, it looks like the most recent version of the patch has addressed your feedback. Do you agree?

          Show
          cnauroth Chris Nauroth added a comment - Hi Jakob Homan . Nice work! I have a few comments. ConfRefreshTokenBasedAccessTokenProvider , ConfRefreshTokenBasedAccessTokenProvider : There are no timeouts specified in the calls to the refresh URL. Timeouts can be controlled by calling client.setConnectTimeout and client.setReadTimeout . AccessTokenProvider : Optional - consider extending Configured so that it inherits the implementations of getConf and setConf for free. WebHDFS.md: Typo: "toekns" instead of "tokens" Please address the javac and checkstyle warnings. Chris Douglas , it looks like the most recent version of the patch has addressed your feedback. Do you agree?
          Hide
          jghoman Jakob Homan added a comment -

          New patch addressing checkstyle and ChrisN's review.

          ConfRefreshTokenBasedAccessTokenProvider, ConfRefreshTokenBasedAccessTokenProvider: There are no timeouts specified in the calls to the refresh URL. Timeouts can be controlled by calling client.setConnectTimeout and client.setReadTimeout.

          Done.

          AccessTokenProvider: Optional - consider extending Configured so that it inherits the implementations of getConf and setConf for free.

          Configured sets the conf as part of the constructor, which breaks the way ATP implementations sets its values. I kept it as Configurable just to avoid code churn.

          WebHDFS.md: Typo: "toekns" instead of "tokens"

          Done.

          Please address the javac and checkstyle warnings.

          Done. my local test patch is happy (at last)

          Show
          jghoman Jakob Homan added a comment - New patch addressing checkstyle and ChrisN's review. ConfRefreshTokenBasedAccessTokenProvider, ConfRefreshTokenBasedAccessTokenProvider: There are no timeouts specified in the calls to the refresh URL. Timeouts can be controlled by calling client.setConnectTimeout and client.setReadTimeout. Done. AccessTokenProvider: Optional - consider extending Configured so that it inherits the implementations of getConf and setConf for free. Configured sets the conf as part of the constructor, which breaks the way ATP implementations sets its values. I kept it as Configurable just to avoid code churn. WebHDFS.md: Typo: "toekns" instead of "tokens" Done. Please address the javac and checkstyle warnings. Done. my local test patch is happy (at last)
          Hide
          chris.douglas Chris Douglas added a comment -
          • ConfRefreshTokenBasedAccessTokenProvider and CredentialBasedAccessTokenProvider::setConf() are missing a call to super.setConf().

          +1 otherwise

          Show
          chris.douglas Chris Douglas added a comment - ConfRefreshTokenBasedAccessTokenProvider and CredentialBasedAccessTokenProvider::setConf() are missing a call to super.setConf() . +1 otherwise
          Hide
          jghoman Jakob Homan added a comment -

          Fixed ChrisD's comment.

          Show
          jghoman Jakob Homan added a comment - Fixed ChrisD's comment.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          -1 pre-patch 22m 23s Pre-patch trunk has 2 extant Findbugs (version 3.0.0) warnings.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 4 new or modified test files.
          +1 javac 9m 5s There were no new javac warning messages.
          +1 javadoc 10m 29s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          +1 site 3m 9s Site still builds.
          -1 checkstyle 2m 55s The applied patch generated 1 new checkstyle issues (total was 149, now 149).
          +1 whitespace 0m 1s The patch has no lines that end in whitespace.
          +1 install 1m 33s mvn install still works.
          +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
          +1 findbugs 4m 41s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 native 3m 21s Pre-build of native portion
          -1 hdfs tests 181m 42s Tests failed in hadoop-hdfs.
          -1 hdfs tests 0m 56s Tests failed in hadoop-hdfs-client.
              241m 16s  



          Reason Tests
          Failed unit tests hadoop.hdfs.TestLeaseRecovery2
            hadoop.hdfs.web.TestWebHDFSOAuth2
          Timed out tests org.apache.hadoop.hdfs.TestRollingUpgrade
            org.apache.hadoop.hdfs.TestDecommission
          Failed build hadoop-hdfs-client



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12752868/HDFS-8155.003.patch
          Optional Tests javadoc javac unit findbugs checkstyle site
          git revision trunk / a9c8ea7
          Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12177/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html
          checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/12177/artifact/patchprocess/diffcheckstylehadoop-hdfs-client.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12177/artifact/patchprocess/testrun_hadoop-hdfs.txt
          hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12177/artifact/patchprocess/testrun_hadoop-hdfs-client.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12177/testReport/
          Java 1.7.0_55
          uname Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12177/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 pre-patch 22m 23s Pre-patch trunk has 2 extant Findbugs (version 3.0.0) warnings. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 4 new or modified test files. +1 javac 9m 5s There were no new javac warning messages. +1 javadoc 10m 29s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 site 3m 9s Site still builds. -1 checkstyle 2m 55s The applied patch generated 1 new checkstyle issues (total was 149, now 149). +1 whitespace 0m 1s The patch has no lines that end in whitespace. +1 install 1m 33s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 4m 41s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 21s Pre-build of native portion -1 hdfs tests 181m 42s Tests failed in hadoop-hdfs. -1 hdfs tests 0m 56s Tests failed in hadoop-hdfs-client.     241m 16s   Reason Tests Failed unit tests hadoop.hdfs.TestLeaseRecovery2   hadoop.hdfs.web.TestWebHDFSOAuth2 Timed out tests org.apache.hadoop.hdfs.TestRollingUpgrade   org.apache.hadoop.hdfs.TestDecommission Failed build hadoop-hdfs-client Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12752868/HDFS-8155.003.patch Optional Tests javadoc javac unit findbugs checkstyle site git revision trunk / a9c8ea7 Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12177/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/12177/artifact/patchprocess/diffcheckstylehadoop-hdfs-client.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12177/artifact/patchprocess/testrun_hadoop-hdfs.txt hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12177/artifact/patchprocess/testrun_hadoop-hdfs-client.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12177/testReport/ Java 1.7.0_55 uname Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12177/console This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          -1 pre-patch 22m 29s Pre-patch trunk has 2 extant Findbugs (version 3.0.0) warnings.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 4 new or modified test files.
          +1 javac 7m 52s There were no new javac warning messages.
          +1 javadoc 10m 13s There were no new javadoc warning messages.
          +1 release audit 0m 24s The applied patch does not increase the total number of release audit warnings.
          +1 site 3m 5s Site still builds.
          +1 checkstyle 2m 38s There were no new checkstyle issues.
          +1 whitespace 0m 1s The patch has no lines that end in whitespace.
          +1 install 1m 30s mvn install still works.
          +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
          +1 findbugs 4m 31s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 native 3m 13s Pre-build of native portion
          -1 hdfs tests 197m 53s Tests failed in hadoop-hdfs.
          -1 hdfs tests 0m 32s Tests failed in hadoop-hdfs-client.
              255m 0s  



          Reason Tests
          Failed unit tests hadoop.hdfs.web.oauth2.TestRefreshTokenTimeBasedTokenRefresher
            hadoop.hdfs.web.TestWebHDFSOAuth2
            hadoop.hdfs.TestDecommission
            hadoop.hdfs.web.oauth2.TestAccessTokenTimer
            hadoop.hdfs.server.namenode.TestFileTruncate
            hadoop.hdfs.web.oauth2.TestClientCredentialTimeBasedTokenRefresher
            hadoop.hdfs.server.namenode.TestNameNodeMetricsLogger
            hadoop.hdfs.server.namenode.TestFSNamesystem
          Failed build hadoop-hdfs-client



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12752871/HDFS-8155.004.patch
          Optional Tests javadoc javac unit findbugs checkstyle site
          git revision trunk / a9c8ea7
          Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12178/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12178/artifact/patchprocess/testrun_hadoop-hdfs.txt
          hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12178/artifact/patchprocess/testrun_hadoop-hdfs-client.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12178/testReport/
          Java 1.7.0_55
          uname Linux asf908.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12178/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 pre-patch 22m 29s Pre-patch trunk has 2 extant Findbugs (version 3.0.0) warnings. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 4 new or modified test files. +1 javac 7m 52s There were no new javac warning messages. +1 javadoc 10m 13s There were no new javadoc warning messages. +1 release audit 0m 24s The applied patch does not increase the total number of release audit warnings. +1 site 3m 5s Site still builds. +1 checkstyle 2m 38s There were no new checkstyle issues. +1 whitespace 0m 1s The patch has no lines that end in whitespace. +1 install 1m 30s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. +1 findbugs 4m 31s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 13s Pre-build of native portion -1 hdfs tests 197m 53s Tests failed in hadoop-hdfs. -1 hdfs tests 0m 32s Tests failed in hadoop-hdfs-client.     255m 0s   Reason Tests Failed unit tests hadoop.hdfs.web.oauth2.TestRefreshTokenTimeBasedTokenRefresher   hadoop.hdfs.web.TestWebHDFSOAuth2   hadoop.hdfs.TestDecommission   hadoop.hdfs.web.oauth2.TestAccessTokenTimer   hadoop.hdfs.server.namenode.TestFileTruncate   hadoop.hdfs.web.oauth2.TestClientCredentialTimeBasedTokenRefresher   hadoop.hdfs.server.namenode.TestNameNodeMetricsLogger   hadoop.hdfs.server.namenode.TestFSNamesystem Failed build hadoop-hdfs-client Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12752871/HDFS-8155.004.patch Optional Tests javadoc javac unit findbugs checkstyle site git revision trunk / a9c8ea7 Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12178/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12178/artifact/patchprocess/testrun_hadoop-hdfs.txt hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12178/artifact/patchprocess/testrun_hadoop-hdfs-client.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12178/testReport/ Java 1.7.0_55 uname Linux asf908.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12178/console This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          -1 pre-patch 23m 23s Pre-patch trunk has 2 extant Findbugs (version 3.0.0) warnings.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 4 new or modified test files.
          +1 javac 7m 55s There were no new javac warning messages.
          +1 javadoc 10m 12s There were no new javadoc warning messages.
          +1 release audit 0m 24s The applied patch does not increase the total number of release audit warnings.
          +1 site 3m 0s Site still builds.
          +1 checkstyle 3m 7s There were no new checkstyle issues.
          +1 whitespace 0m 1s The patch has no lines that end in whitespace.
          +1 install 1m 30s mvn install still works.
          +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse.
          -1 findbugs 1m 10s Post-patch findbugs hadoop-hdfs-project/hadoop-hdfs compilation is broken.
          -1 findbugs 1m 38s Post-patch findbugs hadoop-hdfs-project/hadoop-hdfs-client compilation is broken.
          +1 findbugs 1m 38s The patch does not introduce any new Findbugs (version ) warnings.
          +1 native 0m 23s Pre-build of native portion
          -1 hdfs tests 0m 39s Tests failed in hadoop-hdfs.
          +1 hdfs tests 0m 28s Tests passed in hadoop-hdfs-client.
              53m 16s  



          Reason Tests
          Failed build hadoop-hdfs



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12752897/HDFS-8155.005.patch
          Optional Tests javadoc javac unit findbugs checkstyle site
          git revision trunk / 035ed26
          Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12183/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12183/artifact/patchprocess/testrun_hadoop-hdfs.txt
          hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12183/artifact/patchprocess/testrun_hadoop-hdfs-client.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12183/testReport/
          Java 1.7.0_55
          uname Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12183/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 pre-patch 23m 23s Pre-patch trunk has 2 extant Findbugs (version 3.0.0) warnings. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 4 new or modified test files. +1 javac 7m 55s There were no new javac warning messages. +1 javadoc 10m 12s There were no new javadoc warning messages. +1 release audit 0m 24s The applied patch does not increase the total number of release audit warnings. +1 site 3m 0s Site still builds. +1 checkstyle 3m 7s There were no new checkstyle issues. +1 whitespace 0m 1s The patch has no lines that end in whitespace. +1 install 1m 30s mvn install still works. +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse. -1 findbugs 1m 10s Post-patch findbugs hadoop-hdfs-project/hadoop-hdfs compilation is broken. -1 findbugs 1m 38s Post-patch findbugs hadoop-hdfs-project/hadoop-hdfs-client compilation is broken. +1 findbugs 1m 38s The patch does not introduce any new Findbugs (version ) warnings. +1 native 0m 23s Pre-build of native portion -1 hdfs tests 0m 39s Tests failed in hadoop-hdfs. +1 hdfs tests 0m 28s Tests passed in hadoop-hdfs-client.     53m 16s   Reason Tests Failed build hadoop-hdfs Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12752897/HDFS-8155.005.patch Optional Tests javadoc javac unit findbugs checkstyle site git revision trunk / 035ed26 Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12183/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12183/artifact/patchprocess/testrun_hadoop-hdfs.txt hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12183/artifact/patchprocess/testrun_hadoop-hdfs-client.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12183/testReport/ Java 1.7.0_55 uname Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12183/console This message was automatically generated.
          Hide
          cnauroth Chris Nauroth added a comment -
                client.setConnectTimeout(URLConnectionFactory.DEFAULT_SOCKET_TIMEOUT,
                    TimeUnit.MILLISECONDS);
          

          Sorry if my earlier comment was unclear, but I think we need to call both client.setConnectTimeout and client.setReadTimeout. Otherwise, we could have a successful connection, but then hang indefinitely on a non-responsive server.

          +1 after that.

          I don't know what happened with that last Jenkins run. It's building fine for me locally.

          Show
          cnauroth Chris Nauroth added a comment - client.setConnectTimeout(URLConnectionFactory.DEFAULT_SOCKET_TIMEOUT, TimeUnit.MILLISECONDS); Sorry if my earlier comment was unclear, but I think we need to call both client.setConnectTimeout and client.setReadTimeout . Otherwise, we could have a successful connection, but then hang indefinitely on a non-responsive server. +1 after that. I don't know what happened with that last Jenkins run. It's building fine for me locally.
          Hide
          jghoman Jakob Homan added a comment -

          Fixed ChrisN's final coment. Yeah, Jenkins is being weird for me. I ran through all the HDFS tests manually and except for a couple non-repeatable, unrelated failures, everything passed. I'll let Jenkins run again, but unless it's something real, I'll go ahead and commit this later today. Thanks.

          Show
          jghoman Jakob Homan added a comment - Fixed ChrisN's final coment. Yeah, Jenkins is being weird for me. I ran through all the HDFS tests manually and except for a couple non-repeatable, unrelated failures, everything passed. I'll let Jenkins run again, but unless it's something real, I'll go ahead and commit this later today. Thanks.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          -1 pre-patch 20m 21s Findbugs (version 3.0.0) appears to be broken on trunk.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 4 new or modified test files.
          +1 javac 7m 57s There were no new javac warning messages.
          +1 javadoc 9m 53s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          +1 site 3m 0s Site still builds.
          +1 checkstyle 2m 0s There were no new checkstyle issues.
          +1 whitespace 0m 1s The patch has no lines that end in whitespace.
          +1 install 1m 35s mvn install still works.
          +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
          +1 findbugs 4m 22s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 native 3m 10s Pre-build of native portion
          -1 hdfs tests 127m 13s Tests failed in hadoop-hdfs.
          +1 hdfs tests 0m 28s Tests passed in hadoop-hdfs-client.
              181m 1s  



          Reason Tests
          Failed unit tests hadoop.hdfs.TestFileAppend4
            hadoop.hdfs.TestRead
            hadoop.hdfs.server.namenode.snapshot.TestSnapshot
            hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd
            hadoop.hdfs.server.namenode.ha.TestHAStateTransitions
            hadoop.hdfs.TestHdfsAdmin
            hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting
            hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN
            hadoop.hdfs.TestClientReportBadBlock
            hadoop.hdfs.server.namenode.TestNamenodeCapacityReport
            hadoop.hdfs.server.namenode.TestNamenodeRetryCache
            hadoop.hdfs.server.namenode.TestFSEditLogLoader
            hadoop.hdfs.server.namenode.TestAuditLogger
            hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy
            hadoop.hdfs.server.datanode.TestDataNodeMetrics
            hadoop.hdfs.TestAppendSnapshotTruncate
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles
            hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement
            hadoop.hdfs.TestFileAppendRestart
            hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade
            hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot
            hadoop.hdfs.server.namenode.ha.TestHAFsck
            hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots
            hadoop.hdfs.server.namenode.TestBlockPlacementPolicyRackFaultTolerant
            hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
            hadoop.hdfs.server.namenode.TestHDFSConcat
            hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
            hadoop.TestRefreshCallQueue
            hadoop.hdfs.TestListFilesInDFS
            hadoop.hdfs.server.namenode.TestAddBlock
            hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold
            hadoop.hdfs.server.namenode.TestNameEditsConfigs
            hadoop.hdfs.server.mover.TestMover
            hadoop.security.TestPermissionSymlinks
            hadoop.hdfs.TestDFSRollback
            hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots
            hadoop.hdfs.server.namenode.ha.TestHASafeMode
            hadoop.hdfs.TestFileConcurrentReader
            hadoop.hdfs.TestFileAppend2
            hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA
            hadoop.hdfs.TestGetFileChecksum
            hadoop.hdfs.server.namenode.TestSnapshotPathINodes
            hadoop.hdfs.server.namenode.ha.TestHAMetrics
            hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes
            hadoop.hdfs.server.namenode.ha.TestDNFencing
            hadoop.hdfs.server.namenode.TestFSImageWithSnapshot
            hadoop.hdfs.crypto.TestHdfsCryptoStreams
            hadoop.hdfs.server.namenode.snapshot.TestDisallowModifyROSnapshot
            hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart
            hadoop.hdfs.server.namenode.TestFSDirectory
            hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
            hadoop.hdfs.server.datanode.TestTriggerBlockReport
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion
            hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks
            hadoop.hdfs.TestBlockStoragePolicy
            hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots
            hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes
            hadoop.hdfs.server.datanode.TestReadOnlySharedStorage
            hadoop.hdfs.TestCrcCorruption
            hadoop.hdfs.server.namenode.TestLargeDirectoryDelete
            hadoop.hdfs.TestDFSUpgrade
            hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
            hadoop.hdfs.server.namenode.TestEditLogJournalFailures
            hadoop.hdfs.server.namenode.TestDeleteRace
            hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication
            hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages
            hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation
            hadoop.hdfs.server.datanode.TestIncrementalBrVariations
            hadoop.hdfs.TestLeaseRecovery2
            hadoop.hdfs.server.namenode.TestAclConfigFlag
            hadoop.cli.TestXAttrCLI
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename
            hadoop.hdfs.server.blockmanagement.TestBlockManager
            hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork
            hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes
            hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer
            hadoop.hdfs.server.balancer.TestBalancer
            hadoop.hdfs.server.namenode.TestDefaultBlockPlacementPolicy
            hadoop.hdfs.server.namenode.TestFSImageWithAcl
            hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration
            hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM
            hadoop.hdfs.TestDFSShell
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotStatsMXBean
            hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer
            hadoop.hdfs.server.namenode.TestFSImageWithXAttr
            hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer
            hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA
            hadoop.hdfs.server.namenode.TestEditLog
            hadoop.hdfs.server.datanode.TestDiskError
            hadoop.hdfs.server.namenode.TestCacheDirectives
            hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality
            hadoop.hdfs.server.namenode.TestFileTruncate
            hadoop.security.TestPermission
            hadoop.hdfs.server.namenode.snapshot.TestFileContextSnapshot
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory
            hadoop.hdfs.TestFileCreationDelete
            hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot
            hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS
            hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport
            hadoop.hdfs.TestDFSStorageStateRecovery
            hadoop.hdfs.server.namenode.TestXAttrConfigFlag
            hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA
            hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement
            hadoop.hdfs.server.blockmanagement.TestNodeCount
            hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover
            hadoop.hdfs.TestAppendDifferentChecksum
            hadoop.hdfs.TestRemoteBlockReader
            hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps
            hadoop.hdfs.TestRestartDFS
            hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes
            hadoop.cli.TestHDFSCLI
            hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage
            hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits
            hadoop.hdfs.server.namenode.TestDecommissioningStatus
            hadoop.hdfs.server.namenode.ha.TestStandbyIsHot
            hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles
            hadoop.hdfs.server.datanode.TestBlockScanner
            hadoop.hdfs.server.mover.TestStorageMover
            hadoop.hdfs.TestHDFSFileSystemContract
            hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation
            hadoop.cli.TestAclCLI
            hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
            hadoop.hdfs.TestDFSPermission
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery
            hadoop.hdfs.server.namenode.ha.TestEditLogTailer
            hadoop.cli.TestCryptoAdminCLI
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters
            hadoop.hdfs.server.namenode.ha.TestQuotasWithHA
            hadoop.hdfs.server.datanode.TestDirectoryScanner
            hadoop.hdfs.server.datanode.TestDeleteBlockPool
            hadoop.hdfs.TestBlockReaderLocalLegacy
            hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
            hadoop.hdfs.server.namenode.TestEditLogAutoroll
            hadoop.hdfs.security.token.block.TestBlockToken
            hadoop.hdfs.server.namenode.TestGetBlockLocations
            hadoop.hdfs.server.namenode.TestSecureNameNode
            hadoop.hdfs.server.namenode.TestNameNodeXAttr
            hadoop.hdfs.server.datanode.TestBlockRecovery
            hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock
            hadoop.hdfs.TestDFSStartupVersions
            hadoop.hdfs.TestWriteBlockGetsBlockLengthHint
            hadoop.hdfs.TestAbandonBlock
            hadoop.hdfs.TestFetchImage
            hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotListing
            hadoop.hdfs.server.blockmanagement.TestSequentialBlockId
            hadoop.hdfs.server.namenode.ha.TestHAAppend
            hadoop.hdfs.TestDatanodeDeath
            hadoop.hdfs.server.namenode.TestFSNamesystem
            hadoop.hdfs.server.datanode.TestFsDatasetCache
            hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol
            hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
            hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
            hadoop.hdfs.server.datanode.fsdataset.impl.TestRbwSpaceReservation
            hadoop.hdfs.security.TestDelegationToken
            hadoop.hdfs.server.datanode.TestCachingStrategy
            hadoop.hdfs.TestDFSClientExcludedNodes
            hadoop.hdfs.server.namenode.TestFsck
            hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits
            hadoop.hdfs.TestSnapshotCommands
            hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks
            hadoop.hdfs.server.datanode.TestHSync
            hadoop.hdfs.server.namenode.TestProcessCorruptBlocks
            hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing
            hadoop.hdfs.TestDFSInputStream
            hadoop.hdfs.TestDFSOutputStream
            hadoop.hdfs.server.namenode.TestNameNodeAcl
            hadoop.hdfs.server.namenode.TestQuotaByStorageType
            hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages
            hadoop.hdfs.server.datanode.TestBlockReplacement
            hadoop.hdfs.server.namenode.TestBlockUnderConstruction
            hadoop.hdfs.TestDFSInotifyEventInputStream
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics
            hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication
            hadoop.hdfs.server.namenode.TestNameNodeMXBean
            hadoop.hdfs.security.TestDelegationTokenForProxyUser
            hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade
            hadoop.hdfs.server.namenode.ha.TestFailureOfSharedDir
            hadoop.hdfs.server.datanode.TestTransferRbw
            hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
            hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter
            hadoop.hdfs.server.namenode.TestFileContextXAttr
            hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled
            hadoop.hdfs.server.namenode.TestHostsFiles
            hadoop.hdfs.TestReservedRawPaths
            hadoop.hdfs.server.namenode.TestNameNodeRecovery
            hadoop.hdfs.server.blockmanagement.TestPendingReplication
            hadoop.hdfs.TestFileCorruption
            hadoop.hdfs.server.namenode.TestStorageRestore
            hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate
            hadoop.hdfs.server.namenode.TestINodeAttributeProvider
          Timed out tests org.apache.hadoop.hdfs.server.namenode.TestNNThroughputBenchmark



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12753024/HDFS-8155.006.patch
          Optional Tests javadoc javac unit findbugs checkstyle site
          git revision trunk / beb65c9
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12198/artifact/patchprocess/testrun_hadoop-hdfs.txt
          hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12198/artifact/patchprocess/testrun_hadoop-hdfs-client.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12198/testReport/
          Java 1.7.0_55
          uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12198/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 pre-patch 20m 21s Findbugs (version 3.0.0) appears to be broken on trunk. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 4 new or modified test files. +1 javac 7m 57s There were no new javac warning messages. +1 javadoc 9m 53s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 site 3m 0s Site still builds. +1 checkstyle 2m 0s There were no new checkstyle issues. +1 whitespace 0m 1s The patch has no lines that end in whitespace. +1 install 1m 35s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 4m 22s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 10s Pre-build of native portion -1 hdfs tests 127m 13s Tests failed in hadoop-hdfs. +1 hdfs tests 0m 28s Tests passed in hadoop-hdfs-client.     181m 1s   Reason Tests Failed unit tests hadoop.hdfs.TestFileAppend4   hadoop.hdfs.TestRead   hadoop.hdfs.server.namenode.snapshot.TestSnapshot   hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd   hadoop.hdfs.server.namenode.ha.TestHAStateTransitions   hadoop.hdfs.TestHdfsAdmin   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting   hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN   hadoop.hdfs.TestClientReportBadBlock   hadoop.hdfs.server.namenode.TestNamenodeCapacityReport   hadoop.hdfs.server.namenode.TestNamenodeRetryCache   hadoop.hdfs.server.namenode.TestFSEditLogLoader   hadoop.hdfs.server.namenode.TestAuditLogger   hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy   hadoop.hdfs.server.datanode.TestDataNodeMetrics   hadoop.hdfs.TestAppendSnapshotTruncate   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles   hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement   hadoop.hdfs.TestFileAppendRestart   hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade   hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot   hadoop.hdfs.server.namenode.ha.TestHAFsck   hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots   hadoop.hdfs.server.namenode.TestBlockPlacementPolicyRackFaultTolerant   hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot   hadoop.hdfs.server.namenode.TestHDFSConcat   hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics   hadoop.TestRefreshCallQueue   hadoop.hdfs.TestListFilesInDFS   hadoop.hdfs.server.namenode.TestAddBlock   hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold   hadoop.hdfs.server.namenode.TestNameEditsConfigs   hadoop.hdfs.server.mover.TestMover   hadoop.security.TestPermissionSymlinks   hadoop.hdfs.TestDFSRollback   hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots   hadoop.hdfs.server.namenode.ha.TestHASafeMode   hadoop.hdfs.TestFileConcurrentReader   hadoop.hdfs.TestFileAppend2   hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA   hadoop.hdfs.TestGetFileChecksum   hadoop.hdfs.server.namenode.TestSnapshotPathINodes   hadoop.hdfs.server.namenode.ha.TestHAMetrics   hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes   hadoop.hdfs.server.namenode.ha.TestDNFencing   hadoop.hdfs.server.namenode.TestFSImageWithSnapshot   hadoop.hdfs.crypto.TestHdfsCryptoStreams   hadoop.hdfs.server.namenode.snapshot.TestDisallowModifyROSnapshot   hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart   hadoop.hdfs.server.namenode.TestFSDirectory   hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes   hadoop.hdfs.server.datanode.TestTriggerBlockReport   hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion   hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks   hadoop.hdfs.TestBlockStoragePolicy   hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots   hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes   hadoop.hdfs.server.datanode.TestReadOnlySharedStorage   hadoop.hdfs.TestCrcCorruption   hadoop.hdfs.server.namenode.TestLargeDirectoryDelete   hadoop.hdfs.TestDFSUpgrade   hadoop.hdfs.server.namenode.ha.TestPipelinesFailover   hadoop.hdfs.server.namenode.TestEditLogJournalFailures   hadoop.hdfs.server.namenode.TestDeleteRace   hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication   hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages   hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation   hadoop.hdfs.server.datanode.TestIncrementalBrVariations   hadoop.hdfs.TestLeaseRecovery2   hadoop.hdfs.server.namenode.TestAclConfigFlag   hadoop.cli.TestXAttrCLI   hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename   hadoop.hdfs.server.blockmanagement.TestBlockManager   hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork   hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes   hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer   hadoop.hdfs.server.balancer.TestBalancer   hadoop.hdfs.server.namenode.TestDefaultBlockPlacementPolicy   hadoop.hdfs.server.namenode.TestFSImageWithAcl   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration   hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM   hadoop.hdfs.TestDFSShell   hadoop.hdfs.server.namenode.snapshot.TestSnapshotStatsMXBean   hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer   hadoop.hdfs.server.namenode.TestFSImageWithXAttr   hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer   hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA   hadoop.hdfs.server.namenode.TestEditLog   hadoop.hdfs.server.datanode.TestDiskError   hadoop.hdfs.server.namenode.TestCacheDirectives   hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality   hadoop.hdfs.server.namenode.TestFileTruncate   hadoop.security.TestPermission   hadoop.hdfs.server.namenode.snapshot.TestFileContextSnapshot   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory   hadoop.hdfs.TestFileCreationDelete   hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot   hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS   hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport   hadoop.hdfs.TestDFSStorageStateRecovery   hadoop.hdfs.server.namenode.TestXAttrConfigFlag   hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA   hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement   hadoop.hdfs.server.blockmanagement.TestNodeCount   hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover   hadoop.hdfs.TestAppendDifferentChecksum   hadoop.hdfs.TestRemoteBlockReader   hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps   hadoop.hdfs.TestRestartDFS   hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes   hadoop.cli.TestHDFSCLI   hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage   hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits   hadoop.hdfs.server.namenode.TestDecommissioningStatus   hadoop.hdfs.server.namenode.ha.TestStandbyIsHot   hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles   hadoop.hdfs.server.datanode.TestBlockScanner   hadoop.hdfs.server.mover.TestStorageMover   hadoop.hdfs.TestHDFSFileSystemContract   hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation   hadoop.cli.TestAclCLI   hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints   hadoop.hdfs.TestDFSPermission   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery   hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.cli.TestCryptoAdminCLI   hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap   hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters   hadoop.hdfs.server.namenode.ha.TestQuotasWithHA   hadoop.hdfs.server.datanode.TestDirectoryScanner   hadoop.hdfs.server.datanode.TestDeleteBlockPool   hadoop.hdfs.TestBlockReaderLocalLegacy   hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots   hadoop.hdfs.server.namenode.TestEditLogAutoroll   hadoop.hdfs.security.token.block.TestBlockToken   hadoop.hdfs.server.namenode.TestGetBlockLocations   hadoop.hdfs.server.namenode.TestSecureNameNode   hadoop.hdfs.server.namenode.TestNameNodeXAttr   hadoop.hdfs.server.datanode.TestBlockRecovery   hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock   hadoop.hdfs.TestDFSStartupVersions   hadoop.hdfs.TestWriteBlockGetsBlockLengthHint   hadoop.hdfs.TestAbandonBlock   hadoop.hdfs.TestFetchImage   hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot   hadoop.hdfs.server.namenode.snapshot.TestSnapshotListing   hadoop.hdfs.server.blockmanagement.TestSequentialBlockId   hadoop.hdfs.server.namenode.ha.TestHAAppend   hadoop.hdfs.TestDatanodeDeath   hadoop.hdfs.server.namenode.TestFSNamesystem   hadoop.hdfs.server.datanode.TestFsDatasetCache   hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol   hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure   hadoop.hdfs.server.datanode.fsdataset.impl.TestRbwSpaceReservation   hadoop.hdfs.security.TestDelegationToken   hadoop.hdfs.server.datanode.TestCachingStrategy   hadoop.hdfs.TestDFSClientExcludedNodes   hadoop.hdfs.server.namenode.TestFsck   hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits   hadoop.hdfs.TestSnapshotCommands   hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks   hadoop.hdfs.server.datanode.TestHSync   hadoop.hdfs.server.namenode.TestProcessCorruptBlocks   hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing   hadoop.hdfs.TestDFSInputStream   hadoop.hdfs.TestDFSOutputStream   hadoop.hdfs.server.namenode.TestNameNodeAcl   hadoop.hdfs.server.namenode.TestQuotaByStorageType   hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages   hadoop.hdfs.server.datanode.TestBlockReplacement   hadoop.hdfs.server.namenode.TestBlockUnderConstruction   hadoop.hdfs.TestDFSInotifyEventInputStream   hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics   hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication   hadoop.hdfs.server.namenode.TestNameNodeMXBean   hadoop.hdfs.security.TestDelegationTokenForProxyUser   hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade   hadoop.hdfs.server.namenode.ha.TestFailureOfSharedDir   hadoop.hdfs.server.datanode.TestTransferRbw   hadoop.hdfs.server.namenode.TestListCorruptFileBlocks   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter   hadoop.hdfs.server.namenode.TestFileContextXAttr   hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled   hadoop.hdfs.server.namenode.TestHostsFiles   hadoop.hdfs.TestReservedRawPaths   hadoop.hdfs.server.namenode.TestNameNodeRecovery   hadoop.hdfs.server.blockmanagement.TestPendingReplication   hadoop.hdfs.TestFileCorruption   hadoop.hdfs.server.namenode.TestStorageRestore   hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate   hadoop.hdfs.server.namenode.TestINodeAttributeProvider Timed out tests org.apache.hadoop.hdfs.server.namenode.TestNNThroughputBenchmark Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12753024/HDFS-8155.006.patch Optional Tests javadoc javac unit findbugs checkstyle site git revision trunk / beb65c9 hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12198/artifact/patchprocess/testrun_hadoop-hdfs.txt hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12198/artifact/patchprocess/testrun_hadoop-hdfs-client.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12198/testReport/ Java 1.7.0_55 uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12198/console This message was automatically generated.
          Hide
          jghoman Jakob Homan added a comment -

          The test failures, numerous though they are, are unrelated and happening to other JIRAS as well (HDFS-8983). Having received the rare double-Chris(D|N) +1, I've committed this to trunk and branch-2. Resolving.

          Show
          jghoman Jakob Homan added a comment - The test failures, numerous though they are, are unrelated and happening to other JIRAS as well ( HDFS-8983 ). Having received the rare double-Chris(D|N) +1, I've committed this to trunk and branch-2. Resolving.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8370 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8370/)
          HDFS-8155. Support OAuth2 in WebHDFS. (jghoman: rev 837fb75e8e03b2f016bcea2f4605106a5022491c)

          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfRefreshTokenBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestAccessTokenTimer.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenTimer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestRefreshTokenTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFSOAuth2.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2ConnectionConfigurator.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/package-info.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs-client/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/Utils.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfCredentialBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsClientConfigKeys.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/URLConnectionFactory.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/CredentialBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2Constants.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8370 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8370/ ) HDFS-8155 . Support OAuth2 in WebHDFS. (jghoman: rev 837fb75e8e03b2f016bcea2f4605106a5022491c) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfRefreshTokenBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestAccessTokenTimer.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenTimer.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestRefreshTokenTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFSOAuth2.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2ConnectionConfigurator.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/package-info.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs-client/pom.xml hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/Utils.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfCredentialBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs/pom.xml hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsClientConfigKeys.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/URLConnectionFactory.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/CredentialBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2Constants.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #321 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/321/)
          HDFS-8155. Support OAuth2 in WebHDFS. (jghoman: rev 837fb75e8e03b2f016bcea2f4605106a5022491c)

          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestRefreshTokenTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfRefreshTokenBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfCredentialBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/URLConnectionFactory.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsClientConfigKeys.java
          • hadoop-hdfs-project/hadoop-hdfs/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/CredentialBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2Constants.java
          • hadoop-hdfs-project/hadoop-hdfs-client/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestAccessTokenTimer.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/package-info.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFSOAuth2.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenTimer.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/Utils.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2ConnectionConfigurator.java
          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #321 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/321/ ) HDFS-8155 . Support OAuth2 in WebHDFS. (jghoman: rev 837fb75e8e03b2f016bcea2f4605106a5022491c) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestRefreshTokenTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfRefreshTokenBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfCredentialBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/URLConnectionFactory.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsClientConfigKeys.java hadoop-hdfs-project/hadoop-hdfs/pom.xml hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/CredentialBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2Constants.java hadoop-hdfs-project/hadoop-hdfs-client/pom.xml hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestAccessTokenTimer.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/package-info.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFSOAuth2.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenTimer.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/Utils.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2ConnectionConfigurator.java hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #312 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/312/)
          HDFS-8155. Support OAuth2 in WebHDFS. (jghoman: rev 837fb75e8e03b2f016bcea2f4605106a5022491c)

          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/package-info.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfCredentialBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/CredentialBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2ConnectionConfigurator.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestRefreshTokenTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/Utils.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/URLConnectionFactory.java
          • hadoop-hdfs-project/hadoop-hdfs/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsClientConfigKeys.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenTimer.java
          • hadoop-hdfs-project/hadoop-hdfs-client/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2Constants.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFSOAuth2.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfRefreshTokenBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestAccessTokenTimer.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #312 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/312/ ) HDFS-8155 . Support OAuth2 in WebHDFS. (jghoman: rev 837fb75e8e03b2f016bcea2f4605106a5022491c) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/package-info.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfCredentialBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/CredentialBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2ConnectionConfigurator.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestRefreshTokenTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/Utils.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/URLConnectionFactory.java hadoop-hdfs-project/hadoop-hdfs/pom.xml hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsClientConfigKeys.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenTimer.java hadoop-hdfs-project/hadoop-hdfs-client/pom.xml hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2Constants.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFSOAuth2.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfRefreshTokenBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestAccessTokenTimer.java
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk #1054 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1054/)
          HDFS-8155. Support OAuth2 in WebHDFS. (jghoman: rev 837fb75e8e03b2f016bcea2f4605106a5022491c)

          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestRefreshTokenTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsClientConfigKeys.java
          • hadoop-hdfs-project/hadoop-hdfs-client/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/CredentialBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFSOAuth2.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2ConnectionConfigurator.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/package-info.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/URLConnectionFactory.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfCredentialBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestAccessTokenTimer.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfRefreshTokenBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2Constants.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/Utils.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenTimer.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #1054 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1054/ ) HDFS-8155 . Support OAuth2 in WebHDFS. (jghoman: rev 837fb75e8e03b2f016bcea2f4605106a5022491c) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestRefreshTokenTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsClientConfigKeys.java hadoop-hdfs-project/hadoop-hdfs-client/pom.xml hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/CredentialBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFSOAuth2.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2ConnectionConfigurator.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/package-info.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/URLConnectionFactory.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfCredentialBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestAccessTokenTimer.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfRefreshTokenBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs/pom.xml hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2Constants.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/Utils.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenTimer.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #327 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/327/)
          HDFS-8155. Support OAuth2 in WebHDFS. (jghoman: rev 837fb75e8e03b2f016bcea2f4605106a5022491c)

          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsClientConfigKeys.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfCredentialBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenTimer.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2Constants.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2ConnectionConfigurator.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestRefreshTokenTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/package-info.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/URLConnectionFactory.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/Utils.java
          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFSOAuth2.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/CredentialBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestAccessTokenTimer.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfRefreshTokenBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs-client/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #327 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/327/ ) HDFS-8155 . Support OAuth2 in WebHDFS. (jghoman: rev 837fb75e8e03b2f016bcea2f4605106a5022491c) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsClientConfigKeys.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfCredentialBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenTimer.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2Constants.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2ConnectionConfigurator.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestRefreshTokenTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs/pom.xml hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/package-info.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/URLConnectionFactory.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/Utils.java hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFSOAuth2.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/CredentialBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestAccessTokenTimer.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfRefreshTokenBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs-client/pom.xml hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2251 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2251/)
          HDFS-8155. Support OAuth2 in WebHDFS. (jghoman: rev 837fb75e8e03b2f016bcea2f4605106a5022491c)

          • hadoop-hdfs-project/hadoop-hdfs-client/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfCredentialBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsClientConfigKeys.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestRefreshTokenTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2Constants.java
          • hadoop-hdfs-project/hadoop-hdfs/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/package-info.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfRefreshTokenBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenTimer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFSOAuth2.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/Utils.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/URLConnectionFactory.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestAccessTokenTimer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2ConnectionConfigurator.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/CredentialBasedAccessTokenProvider.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2251 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2251/ ) HDFS-8155 . Support OAuth2 in WebHDFS. (jghoman: rev 837fb75e8e03b2f016bcea2f4605106a5022491c) hadoop-hdfs-project/hadoop-hdfs-client/pom.xml hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfCredentialBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsClientConfigKeys.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestRefreshTokenTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2Constants.java hadoop-hdfs-project/hadoop-hdfs/pom.xml hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/package-info.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfRefreshTokenBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenTimer.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFSOAuth2.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/Utils.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/URLConnectionFactory.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestAccessTokenTimer.java hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2ConnectionConfigurator.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/CredentialBasedAccessTokenProvider.java
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2270 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2270/)
          HDFS-8155. Support OAuth2 in WebHDFS. (jghoman: rev 837fb75e8e03b2f016bcea2f4605106a5022491c)

          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2ConnectionConfigurator.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/CredentialBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFSOAuth2.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/package-info.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/URLConnectionFactory.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestAccessTokenTimer.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfCredentialBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2Constants.java
          • hadoop-hdfs-project/hadoop-hdfs/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsClientConfigKeys.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfRefreshTokenBasedAccessTokenProvider.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenTimer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestRefreshTokenTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs-client/pom.xml
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/Utils.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2270 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2270/ ) HDFS-8155 . Support OAuth2 in WebHDFS. (jghoman: rev 837fb75e8e03b2f016bcea2f4605106a5022491c) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2ConnectionConfigurator.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/CredentialBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFSOAuth2.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/package-info.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/URLConnectionFactory.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestAccessTokenTimer.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfCredentialBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/OAuth2Constants.java hadoop-hdfs-project/hadoop-hdfs/pom.xml hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsClientConfigKeys.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfRefreshTokenBasedAccessTokenProvider.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/AccessTokenTimer.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestRefreshTokenTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs-client/pom.xml hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/oauth2/TestClientCredentialTimeBasedTokenRefresher.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/Utils.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md
          Hide
          wheat9 Haohui Mai added a comment -

          Note that this patch introduces a new dependency, com.squareup.okhttp in the hadoop-hdfs-client package. Please update the release note accordingly.

          cc Steve Loughran

          Show
          wheat9 Haohui Mai added a comment - Note that this patch introduces a new dependency, com.squareup.okhttp in the hadoop-hdfs-client package. Please update the release note accordingly. cc Steve Loughran

            People

            • Assignee:
              jghoman Jakob Homan
              Reporter:
              jghoman Jakob Homan
            • Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development