Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11901

BytesWritable fails to support 2G chunks due to integer overflow

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      BytesWritable.setSize increases the buffer size by 1.5 each time ( * 3 / 2). This is an unsafe operation since it restricts the max size to ~700MB, since 700MB * 3 > 2GB.

      I didn't write a test case for this case because in order to trigger this, I'd need to allocate around 700MB, which is pretty expensive to do in a unit test. Note that I didn't throw any exception in the case integer overflow as I didn't want to change that behavior (callers to this might expect a java.lang.NegativeArraySizeException).

      1. HADOOP-11901.diff
        0.7 kB
        Reynold Xin
      2. HADOOP-11901 (3).diff
        0.8 kB
        Reynold Xin

        Issue Links

          Activity

          Hide
          rxin Reynold Xin added a comment -

          fix

          Show
          rxin Reynold Xin added a comment - fix
          Hide
          rxin Reynold Xin added a comment -

          I uploaded a patch, but haven't been able to build it yet (never built Hadoop before).

          Show
          rxin Reynold Xin added a comment - I uploaded a patch, but haven't been able to build it yet (never built Hadoop before).
          Hide
          rxin Reynold Xin added a comment -

          Note that I didn't throw any exception in the case integer overflow as I didn't want to change that behavior (callers to this might expect a java.lang.NegativeArraySizeException).

          Show
          rxin Reynold Xin added a comment - Note that I didn't throw any exception in the case integer overflow as I didn't want to change that behavior (callers to this might expect a java.lang.NegativeArraySizeException).
          Hide
          gopalv Gopal V added a comment -

          If the only goal is overflow prevention you can skip a multiply and do size + size/2 - the jdk bin-search bug was similar.

          Show
          gopalv Gopal V added a comment - If the only goal is overflow prevention you can skip a multiply and do size + size/2 - the jdk bin-search bug was similar.
          Hide
          cmccabe Colin P. McCabe added a comment - - edited

          Thanks, Reynold Xin. How about something like Math.min(Integer.MAX_VALUE, (3L * size) / 2L)? The current patch still causes an overflow if size is near MAX_INT. (edit: thanks to Sandy Ryza for correcting this... I meant min, not max)

          Show
          cmccabe Colin P. McCabe added a comment - - edited Thanks, Reynold Xin . How about something like Math.min(Integer.MAX_VALUE, (3L * size) / 2L) ? The current patch still causes an overflow if size is near MAX_INT. (edit: thanks to Sandy Ryza for correcting this... I meant min, not max)
          Hide
          sandyr Sandy Ryza added a comment -

          Colin P. McCabe do you mean Math.min?

          Show
          sandyr Sandy Ryza added a comment - Colin P. McCabe do you mean Math.min?
          Hide
          cmccabe Colin P. McCabe added a comment -

          Yeah, I was thinking of min.

          Show
          cmccabe Colin P. McCabe added a comment - Yeah, I was thinking of min.
          Hide
          sandyr Sandy Ryza added a comment -

          Agreed that Colin's proposal is safest.

          Show
          sandyr Sandy Ryza added a comment - Agreed that Colin's proposal is safest.
          Hide
          rxin Reynold Xin added a comment -

          OK updated (haven't compiled it though since it's a new computer)... Might be easier if a committer just patches it.

          Show
          rxin Reynold Xin added a comment - OK updated (haven't compiled it though since it's a new computer)... Might be easier if a committer just patches it.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 patch 0m 1s The patch file was not named according to hadoop's naming conventions. Please see https://wiki.apache.org/hadoop/HowToContribute for instructions.
          0 pre-patch 18m 13s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 javac 8m 40s There were no new javac warning messages.
          +1 javadoc 10m 38s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 1m 12s There were no new checkstyle issues.
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 25s mvn install still works.
          +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
          +1 findbugs 2m 0s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          -1 common tests 22m 59s Tests failed in hadoop-common.
              66m 6s  



          Reason Tests
          Failed unit tests hadoop.net.TestNetUtils
            hadoop.ha.TestZKFailoverController



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12750455/HADOOP-11901%20%283%29.diff
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / 6b1cefc
          hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7467/artifact/patchprocess/testrun_hadoop-common.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7467/testReport/
          Java 1.7.0_55
          uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7467/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 patch 0m 1s The patch file was not named according to hadoop's naming conventions. Please see https://wiki.apache.org/hadoop/HowToContribute for instructions. 0 pre-patch 18m 13s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 8m 40s There were no new javac warning messages. +1 javadoc 10m 38s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 1m 12s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 25s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. +1 findbugs 2m 0s The patch does not introduce any new Findbugs (version 3.0.0) warnings. -1 common tests 22m 59s Tests failed in hadoop-common.     66m 6s   Reason Tests Failed unit tests hadoop.net.TestNetUtils   hadoop.ha.TestZKFailoverController Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12750455/HADOOP-11901%20%283%29.diff Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 6b1cefc hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7467/artifact/patchprocess/testrun_hadoop-common.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7467/testReport/ Java 1.7.0_55 uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7467/console This message was automatically generated.
          Hide
          rxin Reynold Xin added a comment -

          Ping - can somebody merge this?

          Show
          rxin Reynold Xin added a comment - Ping - can somebody merge this?
          Hide
          wheat9 Haohui Mai added a comment -

          +1. I'll commit it shortly.

          Show
          wheat9 Haohui Mai added a comment - +1. I'll commit it shortly.
          Hide
          wheat9 Haohui Mai added a comment -

          I've committed the patch to trunk and branch-2. Thanks Reynold Xin for the contribution.

          Show
          wheat9 Haohui Mai added a comment - I've committed the patch to trunk and branch-2. Thanks Reynold Xin for the contribution.
          Hide
          rxin Reynold Xin added a comment -

          Thanks, Haohui.

          Show
          rxin Reynold Xin added a comment - Thanks, Haohui.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8829 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8829/)
          HADOOP-11901. BytesWritable fails to support 2G chunks due to integer (wheat9: rev 747455a13b710266e1084d2f5a3b18ba14b386e5)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/BytesWritable.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8829 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8829/ ) HADOOP-11901 . BytesWritable fails to support 2G chunks due to integer (wheat9: rev 747455a13b710266e1084d2f5a3b18ba14b386e5) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/BytesWritable.java
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 8s docker + precommit patch detected.
          0 patch 0m 11s The patch file was not named according to hadoop's naming conventions. Please see https://wiki.apache.org/hadoop/HowToContribute for instructions.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 mvninstall 11m 31s trunk passed
          +1 compile 15m 42s trunk passed with JDK v1.8.0_66
          +1 compile 11m 11s trunk passed with JDK v1.7.0_85
          +1 checkstyle 0m 22s trunk passed
          +1 mvnsite 1m 19s trunk passed
          +1 mvneclipse 0m 18s trunk passed
          +1 findbugs 2m 38s trunk passed
          +1 javadoc 1m 23s trunk passed with JDK v1.8.0_66
          +1 javadoc 1m 30s trunk passed with JDK v1.7.0_85
          +1 mvninstall 2m 22s the patch passed
          +1 compile 17m 1s the patch passed with JDK v1.8.0_66
          +1 javac 17m 1s the patch passed
          +1 compile 11m 30s the patch passed with JDK v1.7.0_85
          +1 javac 11m 30s the patch passed
          +1 checkstyle 0m 21s the patch passed
          +1 mvnsite 1m 20s the patch passed
          +1 mvneclipse 0m 17s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 findbugs 2m 41s the patch passed
          +1 javadoc 1m 23s the patch passed with JDK v1.8.0_66
          +1 javadoc 1m 30s the patch passed with JDK v1.7.0_85
          -1 unit 10m 29s hadoop-common in the patch failed with JDK v1.8.0_66.
          -1 unit 9m 37s hadoop-common in the patch failed with JDK v1.7.0_85.
          +1 asflicense 0m 31s Patch does not generate ASF License warnings.
          106m 21s



          Reason Tests
          JDK v1.8.0_66 Failed junit tests hadoop.metrics2.impl.TestGangliaMetrics
            hadoop.ha.TestZKFailoverController
            hadoop.metrics2.impl.TestMetricsSystemImpl
            hadoop.test.TestTimedOutTestsListener
          JDK v1.7.0_85 Failed junit tests hadoop.ipc.TestDecayRpcScheduler
            hadoop.fs.shell.find.TestFind
            hadoop.test.TestTimedOutTestsListener



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:date2015-11-19
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12750455/HADOOP-11901%20%283%29.diff
          JIRA Issue HADOOP-11901
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 2bd3be54b07d 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HADOOP-Build/patchprocess/apache-yetus-3f4279a/precommit/personality/hadoop.sh
          git revision trunk / 866dce4
          findbugs v3.0.0
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/8108/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/8108/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.7.0_85.txt
          unit test logs https://builds.apache.org/job/PreCommit-HADOOP-Build/8108/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HADOOP-Build/8108/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.7.0_85.txt
          JDK v1.7.0_85 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/8108/testReport/
          modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
          Max memory used 79MB
          Powered by Apache Yetus http://yetus.apache.org
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/8108/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 8s docker + precommit patch detected. 0 patch 0m 11s The patch file was not named according to hadoop's naming conventions. Please see https://wiki.apache.org/hadoop/HowToContribute for instructions. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 11m 31s trunk passed +1 compile 15m 42s trunk passed with JDK v1.8.0_66 +1 compile 11m 11s trunk passed with JDK v1.7.0_85 +1 checkstyle 0m 22s trunk passed +1 mvnsite 1m 19s trunk passed +1 mvneclipse 0m 18s trunk passed +1 findbugs 2m 38s trunk passed +1 javadoc 1m 23s trunk passed with JDK v1.8.0_66 +1 javadoc 1m 30s trunk passed with JDK v1.7.0_85 +1 mvninstall 2m 22s the patch passed +1 compile 17m 1s the patch passed with JDK v1.8.0_66 +1 javac 17m 1s the patch passed +1 compile 11m 30s the patch passed with JDK v1.7.0_85 +1 javac 11m 30s the patch passed +1 checkstyle 0m 21s the patch passed +1 mvnsite 1m 20s the patch passed +1 mvneclipse 0m 17s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 2m 41s the patch passed +1 javadoc 1m 23s the patch passed with JDK v1.8.0_66 +1 javadoc 1m 30s the patch passed with JDK v1.7.0_85 -1 unit 10m 29s hadoop-common in the patch failed with JDK v1.8.0_66. -1 unit 9m 37s hadoop-common in the patch failed with JDK v1.7.0_85. +1 asflicense 0m 31s Patch does not generate ASF License warnings. 106m 21s Reason Tests JDK v1.8.0_66 Failed junit tests hadoop.metrics2.impl.TestGangliaMetrics   hadoop.ha.TestZKFailoverController   hadoop.metrics2.impl.TestMetricsSystemImpl   hadoop.test.TestTimedOutTestsListener JDK v1.7.0_85 Failed junit tests hadoop.ipc.TestDecayRpcScheduler   hadoop.fs.shell.find.TestFind   hadoop.test.TestTimedOutTestsListener Subsystem Report/Notes Docker Image:yetus/hadoop:date2015-11-19 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12750455/HADOOP-11901%20%283%29.diff JIRA Issue HADOOP-11901 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 2bd3be54b07d 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HADOOP-Build/patchprocess/apache-yetus-3f4279a/precommit/personality/hadoop.sh git revision trunk / 866dce4 findbugs v3.0.0 unit https://builds.apache.org/job/PreCommit-HADOOP-Build/8108/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-HADOOP-Build/8108/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.7.0_85.txt unit test logs https://builds.apache.org/job/PreCommit-HADOOP-Build/8108/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HADOOP-Build/8108/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.7.0_85.txt JDK v1.7.0_85 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/8108/testReport/ modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common Max memory used 79MB Powered by Apache Yetus http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/8108/console This message was automatically generated.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #686 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/686/)
          HADOOP-11901. BytesWritable fails to support 2G chunks due to integer (wheat9: rev 747455a13b710266e1084d2f5a3b18ba14b386e5)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/BytesWritable.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #686 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/686/ ) HADOOP-11901 . BytesWritable fails to support 2G chunks due to integer (wheat9: rev 747455a13b710266e1084d2f5a3b18ba14b386e5) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/BytesWritable.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2627 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2627/)
          HADOOP-11901. BytesWritable fails to support 2G chunks due to integer (wheat9: rev 747455a13b710266e1084d2f5a3b18ba14b386e5)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/BytesWritable.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2627 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2627/ ) HADOOP-11901 . BytesWritable fails to support 2G chunks due to integer (wheat9: rev 747455a13b710266e1084d2f5a3b18ba14b386e5) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/BytesWritable.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #1424 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1424/)
          HADOOP-11901. BytesWritable fails to support 2G chunks due to integer (wheat9: rev 747455a13b710266e1084d2f5a3b18ba14b386e5)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/BytesWritable.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #1424 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1424/ ) HADOOP-11901 . BytesWritable fails to support 2G chunks due to integer (wheat9: rev 747455a13b710266e1084d2f5a3b18ba14b386e5) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/BytesWritable.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #698 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/698/)
          HADOOP-11901. BytesWritable fails to support 2G chunks due to integer (wheat9: rev 747455a13b710266e1084d2f5a3b18ba14b386e5)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/BytesWritable.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #698 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/698/ ) HADOOP-11901 . BytesWritable fails to support 2G chunks due to integer (wheat9: rev 747455a13b710266e1084d2f5a3b18ba14b386e5) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/BytesWritable.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2559 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2559/)
          HADOOP-11901. BytesWritable fails to support 2G chunks due to integer (wheat9: rev 747455a13b710266e1084d2f5a3b18ba14b386e5)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/BytesWritable.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2559 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2559/ ) HADOOP-11901 . BytesWritable fails to support 2G chunks due to integer (wheat9: rev 747455a13b710266e1084d2f5a3b18ba14b386e5) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/BytesWritable.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #621 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/621/)
          HADOOP-11901. BytesWritable fails to support 2G chunks due to integer (wheat9: rev 747455a13b710266e1084d2f5a3b18ba14b386e5)

          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/BytesWritable.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #621 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/621/ ) HADOOP-11901 . BytesWritable fails to support 2G chunks due to integer (wheat9: rev 747455a13b710266e1084d2f5a3b18ba14b386e5) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/BytesWritable.java hadoop-common-project/hadoop-common/CHANGES.txt

            People

            • Assignee:
              rxin Reynold Xin
              Reporter:
              rxin Reynold Xin
            • Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development