Hadoop Common
  1. Hadoop Common
  2. HADOOP-7115

Add a cache for getpwuid_r and getpwgid_r calls

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.22.0, 2.0.2-alpha, 0.23.4
    • Fix Version/s: 0.22.1, 2.0.3-alpha
    • Component/s: None
    • Labels:
      None

      Description

      As discussed in HADOOP-6978, a cache helps a lot.

      1. h-7115.1.patch
        14 kB
        Devaraj Das
      2. hadoop-7115-0.22.patch
        19 kB
        Benoy Antony
      3. hadoop-7115-0.22.patch
        16 kB
        Benoy Antony
      4. HADOOP-7115.patch
        16 kB
        Alejandro Abdelnur
      5. HADOOP-7115.patch
        16 kB
        Alejandro Abdelnur
      6. HADOOP-7115.patch
        16 kB
        Alejandro Abdelnur
      7. HADOOP-7115.patch
        17 kB
        Alejandro Abdelnur

        Issue Links

          Activity

          Hide
          Allen Wittenauer added a comment -

          This is what nscd should be providing for you at the OS level. Why do we want another cache?

          Show
          Allen Wittenauer added a comment - This is what nscd should be providing for you at the OS level. Why do we want another cache?
          Hide
          Jakob Homan added a comment -

          In production we found nscd to be very unreliable, causing storms against the LDAP server when it goes down.

          Show
          Jakob Homan added a comment - In production we found nscd to be very unreliable, causing storms against the LDAP server when it goes down.
          Hide
          Allen Wittenauer added a comment -

          Do we actually know it was getpwuid or some other call? Yahoo uses a lot of netgroup info--which is not cached by nscd. The other thing is that nscd is tunable. You might have just needed to bump up the size of the ncsd cache.

          Given how previous "caches" have been implemented, I'm extremely hesitant to see another one implemented. Especially one that would likely require ops to bring the whole grid down to fix. [It is bad enough we have to bounce the NN/JT to fix some of these caches.]

          Show
          Allen Wittenauer added a comment - Do we actually know it was getpwuid or some other call? Yahoo uses a lot of netgroup info--which is not cached by nscd. The other thing is that nscd is tunable. You might have just needed to bump up the size of the ncsd cache. Given how previous "caches" have been implemented, I'm extremely hesitant to see another one implemented. Especially one that would likely require ops to bring the whole grid down to fix. [It is bad enough we have to bounce the NN/JT to fix some of these caches.]
          Hide
          Devaraj Das added a comment -

          It was the getpwuid calls leading to ldap outages in our major clusters (almost twice every week). After implementing this cache, we didn't have a single incident (and hopefully we will have none in the future too).

          The version of nscd on our clusters proved to be really unreliable.

          Show
          Devaraj Das added a comment - It was the getpwuid calls leading to ldap outages in our major clusters (almost twice every week). After implementing this cache, we didn't have a single incident (and hopefully we will have none in the future too). The version of nscd on our clusters proved to be really unreliable.
          Hide
          Koji Noguchi added a comment -

          Devaraj, can we make this cache timeout period configurable ?
          If yes, ops would have an option to set this timeout to 0 to skip the caching altogether.
          Allen, will this address your concern?

          We really had miserable weeks when our LDAP servers were going up and down. Don't want to go back there.

          Show
          Koji Noguchi added a comment - Devaraj, can we make this cache timeout period configurable ? If yes, ops would have an option to set this timeout to 0 to skip the caching altogether. Allen, will this address your concern? We really had miserable weeks when our LDAP servers were going up and down. Don't want to go back there.
          Hide
          Allen Wittenauer added a comment -

          Do we really want to set a precedent where we start patching Hadoop due to specific vendor's implementation problems? That's where we are headed with this patch....

          Show
          Allen Wittenauer added a comment - Do we really want to set a precedent where we start patching Hadoop due to specific vendor's implementation problems? That's where we are headed with this patch....
          Hide
          Todd Lipcon added a comment -

          Do we really want to set a precedent where we start patching Hadoop due to specific vendor's implementation problems

          Yes. In my opinion this is unavoidable for large scale systems.

          But I agree with Koji that these workarounds should be configurable and probably off-by-default.

          Show
          Todd Lipcon added a comment - Do we really want to set a precedent where we start patching Hadoop due to specific vendor's implementation problems Yes. In my opinion this is unavoidable for large scale systems. But I agree with Koji that these workarounds should be configurable and probably off-by-default.
          Hide
          Allen Wittenauer added a comment -

          > Yes. In my opinion this is unavoidable for large scale systems.

          From my understanding, the reliability issue was fixed by upgrading libc and/or nscd. This makes it an OS bug that was fixed with a vendor supplied patch. We need to be very clear on what we want to do when it comes to OS workarounds. Right now, we're incredibly inconsistent. (and yes, I'm thinking specifically of the whoami, getent, etc problems.)

          Show
          Allen Wittenauer added a comment - > Yes. In my opinion this is unavoidable for large scale systems. From my understanding, the reliability issue was fixed by upgrading libc and/or nscd. This makes it an OS bug that was fixed with a vendor supplied patch. We need to be very clear on what we want to do when it comes to OS workarounds. Right now, we're incredibly inconsistent. (and yes, I'm thinking specifically of the whoami, getent, etc problems.)
          Hide
          Todd Lipcon added a comment -

          Hey Devaraj. Any news on this patch for trunk? I need to fix HADOOP-7156 which is likely to conflict with this code.

          Show
          Todd Lipcon added a comment - Hey Devaraj. Any news on this patch for trunk? I need to fix HADOOP-7156 which is likely to conflict with this code.
          Hide
          Devaraj Das added a comment -

          This patch is a straight port from the 20.100 security branch to trunk for the corresponding commit in the security branch. I will also raise a MR jira to address the MR side of the changes.

          Show
          Devaraj Das added a comment - This patch is a straight port from the 20.100 security branch to trunk for the corresponding commit in the security branch. I will also raise a MR jira to address the MR side of the changes.
          Hide
          Todd Lipcon added a comment -

          A few comments:

          • getUIDforFDOwnerforOwner is a kind of messy name - maybe just getUIDForFDOwner?
          • The following should probably be debug level:
            LOG.info("Got UserName " + user + " for UID " + uid + " from the native implementation");
            
          • ensureInitialized has a formatting issue (cacheTimeout is on the same line as the opening if)
          • The log message there should also probably be debug level
          • Do we need fstat and the Stat type at all now? I think not, we might as well remove it.
          • The change in getGroup.c seems unrelated to this JIRA, right?
          Show
          Todd Lipcon added a comment - A few comments: getUIDforFDOwnerforOwner is a kind of messy name - maybe just getUIDForFDOwner? The following should probably be debug level: LOG.info( "Got UserName " + user + " for UID " + uid + " from the native implementation" ); ensureInitialized has a formatting issue (cacheTimeout is on the same line as the opening if) The log message there should also probably be debug level Do we need fstat and the Stat type at all now? I think not, we might as well remove it. The change in getGroup.c seems unrelated to this JIRA, right?
          Hide
          Todd Lipcon added a comment -

          Do we need fstat and the Stat type at all now? I think not, we might as well remove it.

          Actually, just to keep this closer to the 0.20 security branch, why don't we do that part in a separate JIRA. Filed HADOOP-7173.

          Show
          Todd Lipcon added a comment - Do we need fstat and the Stat type at all now? I think not, we might as well remove it. Actually, just to keep this closer to the 0.20 security branch, why don't we do that part in a separate JIRA. Filed HADOOP-7173 .
          Hide
          Benoy Antony added a comment -

          Patch for 22

          Show
          Benoy Antony added a comment - Patch for 22
          Hide
          Benoy Antony added a comment -

          Reattaching the patch after removing the changes for mapreduce. The changes for mapreduce are attached in MAPREDUCE-2353

          Show
          Benoy Antony added a comment - Reattaching the patch after removing the changes for mapreduce. The changes for mapreduce are attached in MAPREDUCE-2353
          Hide
          Konstantin Shvachko added a comment -

          I just committed this to branch 0.22.1. Thank you Deveraj and Benoy.
          Will close it if not needed in other version.

          Show
          Konstantin Shvachko added a comment - I just committed this to branch 0.22.1. Thank you Deveraj and Benoy. Will close it if not needed in other version.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-22-branch #106 (See https://builds.apache.org/job/Hadoop-Common-22-branch/106/)
          HADOOP-7115. Add a cache for getpwuid_r and getpwgid_r calls. Contributed by Devaraj Das and Benoy Antony. (Revision 1346246)

          Result = SUCCESS
          shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1346246
          Files :

          • /hadoop/common/branches/branch-0.22/common/CHANGES.txt
          • /hadoop/common/branches/branch-0.22/common/src/java/core-default.xml
          • /hadoop/common/branches/branch-0.22/common/src/java/org/apache/hadoop/io/SecureIOUtils.java
          • /hadoop/common/branches/branch-0.22/common/src/java/org/apache/hadoop/io/nativeio/NativeIO.java
          • /hadoop/common/branches/branch-0.22/common/src/native/src/org/apache/hadoop/io/nativeio/NativeIO.c
          • /hadoop/common/branches/branch-0.22/common/src/native/src/org/apache/hadoop/security/getGroup.c
          • /hadoop/common/branches/branch-0.22/common/src/test/core/org/apache/hadoop/io/TestSecureIOUtils.java
          • /hadoop/common/branches/branch-0.22/common/src/test/core/org/apache/hadoop/io/nativeio/TestNativeIO.java
          Show
          Hudson added a comment - Integrated in Hadoop-Common-22-branch #106 (See https://builds.apache.org/job/Hadoop-Common-22-branch/106/ ) HADOOP-7115 . Add a cache for getpwuid_r and getpwgid_r calls. Contributed by Devaraj Das and Benoy Antony. (Revision 1346246) Result = SUCCESS shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1346246 Files : /hadoop/common/branches/branch-0.22/common/CHANGES.txt /hadoop/common/branches/branch-0.22/common/src/java/core-default.xml /hadoop/common/branches/branch-0.22/common/src/java/org/apache/hadoop/io/SecureIOUtils.java /hadoop/common/branches/branch-0.22/common/src/java/org/apache/hadoop/io/nativeio/NativeIO.java /hadoop/common/branches/branch-0.22/common/src/native/src/org/apache/hadoop/io/nativeio/NativeIO.c /hadoop/common/branches/branch-0.22/common/src/native/src/org/apache/hadoop/security/getGroup.c /hadoop/common/branches/branch-0.22/common/src/test/core/org/apache/hadoop/io/TestSecureIOUtils.java /hadoop/common/branches/branch-0.22/common/src/test/core/org/apache/hadoop/io/nativeio/TestNativeIO.java
          Hide
          Todd Lipcon added a comment -

          We need this in trunk, branch-2, and probably branch-0.23, too - not sure how it got missed somewhere along the line

          Show
          Todd Lipcon added a comment - We need this in trunk, branch-2, and probably branch-0.23, too - not sure how it got missed somewhere along the line
          Hide
          Alejandro Abdelnur added a comment -

          Just chatted with Devaraj and he is OK with me taking over this JIRA to have a patch for trunk. THX

          Show
          Alejandro Abdelnur added a comment - Just chatted with Devaraj and he is OK with me taking over this JIRA to have a patch for trunk. THX
          Hide
          Alejandro Abdelnur added a comment -

          Patch for trunk. It revives the cache for ID->NAME. It has been refactored a bit to be used for both UIDs and GIDs. It has been tested in a secure cluster configured to use and external directory for user provisioning running terasort jobs. Without this patch the same cluster cannot run a single terasort job for non-local users.

          Show
          Alejandro Abdelnur added a comment - Patch for trunk. It revives the cache for ID->NAME. It has been refactored a bit to be used for both UIDs and GIDs. It has been tested in a secure cluster configured to use and external directory for user provisioning running terasort jobs. Without this patch the same cluster cannot run a single terasort job for non-local users.
          Hide
          Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12552538/HADOOP-7115.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-common-project/hadoop-common.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1719//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1719//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12552538/HADOOP-7115.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . The javadoc tool did not generate any warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-common-project/hadoop-common. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1719//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1719//console This message is automatically generated.
          Hide
          Todd Lipcon added a comment -
          • why is cacheTimeout volatile? You're already synchronizing on the class inside ensureInitialized.
          • instead of ensureInitialized, why not initialize the configuration in the existing static {...}

            block?

          • instead of using ints for USER and GROUP, how about an enum like this:
          enum IdCache {
            USERNAME,
            GROUP;
          
            ConcurrentHashMap<Integer, CachedName> cache =
              new ConcurrentHashMap<Integer, CachedName>();
          }
          
          ...
          
          private static String getName(IdCache cache, int id) {
            CachedName cachedName = cache.cache.get(id);
            ...
          }
          

          this way you get typesafety, and you can just stringify the IdCache instance to get a printable name

          Otherwise looks good to me

          Show
          Todd Lipcon added a comment - why is cacheTimeout volatile? You're already synchronizing on the class inside ensureInitialized . instead of ensureInitialized , why not initialize the configuration in the existing static {...} block? instead of using ints for USER and GROUP , how about an enum like this: enum IdCache { USERNAME, GROUP; ConcurrentHashMap< Integer , CachedName> cache = new ConcurrentHashMap< Integer , CachedName>(); } ... private static String getName(IdCache cache, int id) { CachedName cachedName = cache.cache.get(id); ... } this way you get typesafety, and you can just stringify the IdCache instance to get a printable name Otherwise looks good to me
          Hide
          Alejandro Abdelnur added a comment -

          Thanks for the review Todd, new patch addressing you comments. Minor tweak, converted the INT constants to an ENUM but did not move the cache into the ENUM, left as before (not very keen of mutable ENUMs).

          Show
          Alejandro Abdelnur added a comment - Thanks for the review Todd, new patch addressing you comments. Minor tweak, converted the INT constants to an ENUM but did not move the cache into the ENUM, left as before (not very keen of mutable ENUMs).
          Hide
          Alejandro Abdelnur added a comment -

          Forgot the mention before, the native part of the patch it was done by Sandy Ryza (thx Sandy).

          Show
          Alejandro Abdelnur added a comment - Forgot the mention before, the native part of the patch it was done by Sandy Ryza (thx Sandy).
          Hide
          Todd Lipcon added a comment -
          +    cacheTimeout = new Configuration().getLong(
          +      CommonConfigurationKeys.HADOOP_SECURITY_UID_NAME_CACHE_TIMEOUT_KEY,
          +      CommonConfigurationKeys.HADOOP_SECURITY_UID_NAME_CACHE_TIMEOUT_DEFAULT) *
          +      1000;
          +    LOG.debug("Initialized cache for IDs to User/Group mapping with a" +
          +      " cache timeout of " + cacheTimeout/1000 + " seconds.");
          

          This should move up into the try block above – if the native library fails to load, then it shouldn't log this debug message (since the cache won't ever be used). Additionally you can reuse the Configuration instance that's already constructed above.

          • Just noticed an addition of syslog.h to the native code - doesn't seem to be used.

          Otherwise looks good.

          Show
          Todd Lipcon added a comment - + cacheTimeout = new Configuration().getLong( + CommonConfigurationKeys.HADOOP_SECURITY_UID_NAME_CACHE_TIMEOUT_KEY, + CommonConfigurationKeys.HADOOP_SECURITY_UID_NAME_CACHE_TIMEOUT_DEFAULT) * + 1000; + LOG.debug( "Initialized cache for IDs to User/Group mapping with a" + + " cache timeout of " + cacheTimeout/1000 + " seconds." ); This should move up into the try block above – if the native library fails to load, then it shouldn't log this debug message (since the cache won't ever be used). Additionally you can reuse the Configuration instance that's already constructed above. Just noticed an addition of syslog.h to the native code - doesn't seem to be used. Otherwise looks good.
          Hide
          Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12552549/HADOOP-7115.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-common-project/hadoop-common.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1721//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1721//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12552549/HADOOP-7115.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . The javadoc tool did not generate any warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-common-project/hadoop-common. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1721//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1721//console This message is automatically generated.
          Hide
          Alejandro Abdelnur added a comment -

          New patch addressing Todd's last 2 comments

          Show
          Alejandro Abdelnur added a comment - New patch addressing Todd's last 2 comments
          Hide
          Alejandro Abdelnur added a comment -

          minor udpate, adding private/unstable annotations to the NativeIO.java class

          Show
          Alejandro Abdelnur added a comment - minor udpate, adding private/unstable annotations to the NativeIO.java class
          Hide
          Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12552849/HADOOP-7115.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-common-project/hadoop-common.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1724//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1724//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12552849/HADOOP-7115.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . The javadoc tool did not generate any warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-common-project/hadoop-common. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1724//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1724//console This message is automatically generated.
          Hide
          Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12552849/HADOOP-7115.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-common-project/hadoop-common.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1725//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1725//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12552849/HADOOP-7115.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . The javadoc tool did not generate any warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-common-project/hadoop-common. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1725//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1725//console This message is automatically generated.
          Hide
          Tom White added a comment -

          +1 the latest patch looks good to me.

          Show
          Tom White added a comment - +1 the latest patch looks good to me.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-trunk-Commit #2992 (See https://builds.apache.org/job/Hadoop-trunk-Commit/2992/)
          HADOOP-7115. Add a cache for getpwuid_r and getpwgid_r calls (tucu) (Revision 1407577)

          Result = SUCCESS
          tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1407577
          Files :

          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeys.java
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/SecureIOUtils.java
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/nativeio/NativeIO.java
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/nativeio/NativeIO.c
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/nativeio/TestNativeIO.java
          Show
          Hudson added a comment - Integrated in Hadoop-trunk-Commit #2992 (See https://builds.apache.org/job/Hadoop-trunk-Commit/2992/ ) HADOOP-7115 . Add a cache for getpwuid_r and getpwgid_r calls (tucu) (Revision 1407577) Result = SUCCESS tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1407577 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeys.java /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/SecureIOUtils.java /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/nativeio/NativeIO.java /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/nativeio/NativeIO.c /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/nativeio/TestNativeIO.java
          Hide
          Alejandro Abdelnur added a comment -

          committed to trunk and branch-2.

          Show
          Alejandro Abdelnur added a comment - committed to trunk and branch-2.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Yarn-trunk #32 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/32/)
          HADOOP-7115. Add a cache for getpwuid_r and getpwgid_r calls (tucu) (Revision 1407577)

          Result = SUCCESS
          tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1407577
          Files :

          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeys.java
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/SecureIOUtils.java
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/nativeio/NativeIO.java
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/nativeio/NativeIO.c
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/nativeio/TestNativeIO.java
          Show
          Hudson added a comment - Integrated in Hadoop-Yarn-trunk #32 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/32/ ) HADOOP-7115 . Add a cache for getpwuid_r and getpwgid_r calls (tucu) (Revision 1407577) Result = SUCCESS tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1407577 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeys.java /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/SecureIOUtils.java /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/nativeio/NativeIO.java /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/nativeio/NativeIO.c /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/nativeio/TestNativeIO.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #1222 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1222/)
          HADOOP-7115. Add a cache for getpwuid_r and getpwgid_r calls (tucu) (Revision 1407577)

          Result = SUCCESS
          tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1407577
          Files :

          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeys.java
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/SecureIOUtils.java
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/nativeio/NativeIO.java
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/nativeio/NativeIO.c
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/nativeio/TestNativeIO.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #1222 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1222/ ) HADOOP-7115 . Add a cache for getpwuid_r and getpwgid_r calls (tucu) (Revision 1407577) Result = SUCCESS tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1407577 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeys.java /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/SecureIOUtils.java /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/nativeio/NativeIO.java /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/nativeio/NativeIO.c /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/nativeio/TestNativeIO.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #1253 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1253/)
          HADOOP-7115. Add a cache for getpwuid_r and getpwgid_r calls (tucu) (Revision 1407577)

          Result = FAILURE
          tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1407577
          Files :

          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeys.java
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/SecureIOUtils.java
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/nativeio/NativeIO.java
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/nativeio/NativeIO.c
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/nativeio/TestNativeIO.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #1253 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1253/ ) HADOOP-7115 . Add a cache for getpwuid_r and getpwgid_r calls (tucu) (Revision 1407577) Result = FAILURE tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1407577 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeys.java /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/SecureIOUtils.java /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/nativeio/NativeIO.java /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/nativeio/NativeIO.c /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/nativeio/TestNativeIO.java

            People

            • Assignee:
              Alejandro Abdelnur
              Reporter:
              Arun C Murthy
            • Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development