Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.23.0
    • Component/s: contrib/raid
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      GaloisField is immutable and should be kept reuse after creation to avoid redundant calculation of the multiplication and division tables.

      1. MAPREDUCE-2302.txt
        4 kB
        Scott Chen
      2. MAPREDUCE-2302.2.txt
        4 kB
        Scott Chen
      3. MAPREDUCE-2302.3.txt
        4 kB
        Scott Chen

        Activity

        Scott Chen created issue -
        Scott Chen made changes -
        Field Original Value New Value
        Attachment MAPREDUCE-2302.txt [ 12470185 ]
        Scott Chen made changes -
        Status Open [ 1 ] In Progress [ 3 ]
        Scott Chen made changes -
        Status In Progress [ 3 ] Patch Available [ 10002 ]
        Hide
        Scott Chen added a comment -
        
             [exec] BUILD SUCCESSFUL
             [exec] Total time: 2 minutes 16 seconds
             [exec]
             [exec]
             [exec]
             [exec]
             [exec] +1 overall.
             [exec]
             [exec]     +1 @author.  The patch does not contain any @author tags.
             [exec]
             [exec]     +1 tests included.  The patch appears to include 3 new or modified tests.
             [exec]
             [exec]     +1 javadoc.  The javadoc tool did not generate any warning messages.
             [exec]
             [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler warnings.
             [exec]
             [exec]     +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.
             [exec]
             [exec]     +1 release audit.  The applied patch does not increase the total number of release audit warnings.
             [exec]
             [exec]     +1 system test framework.  The patch passed system test framework compile.
             [exec]
             [exec]
             [exec]
             [exec]
             [exec] ======================================================================
             [exec] ======================================================================
             [exec]     Finished build.
             [exec] ======================================================================
             [exec] ======================================================================
        
        Show
        Scott Chen added a comment - [exec] BUILD SUCCESSFUL [exec] Total time: 2 minutes 16 seconds [exec] [exec] [exec] [exec] [exec] +1 overall. [exec] [exec] +1 @author. The patch does not contain any @author tags. [exec] [exec] +1 tests included. The patch appears to include 3 new or modified tests. [exec] [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] [exec] +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. [exec] [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings. [exec] [exec] +1 system test framework. The patch passed system test framework compile. [exec] [exec] [exec] [exec] [exec] ====================================================================== [exec] ====================================================================== [exec] Finished build. [exec] ====================================================================== [exec] ======================================================================
        Hide
        Scott Chen added a comment -

        Addressed some offline comments from Ram

        Show
        Scott Chen added a comment - Addressed some offline comments from Ram
        Scott Chen made changes -
        Attachment MAPREDUCE-2302.2.txt [ 12470333 ]
        Scott Chen made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Scott Chen made changes -
        Status Open [ 1 ] In Progress [ 3 ]
        Scott Chen made changes -
        Status In Progress [ 3 ] Patch Available [ 10002 ]
        Hide
        Tsz Wo Nicholas Sze added a comment -
        +    int key = ((fieldSize << 16) & 0xFF00) + (primitivePolynomial & 0xFF);
        

        Since the shift is 16, should the masks be 0xFFFF0000 and 0xFFFF?

        Show
        Tsz Wo Nicholas Sze added a comment - + int key = ((fieldSize << 16) & 0xFF00) + (primitivePolynomial & 0xFF); Since the shift is 16, should the masks be 0xFFFF0000 and 0xFFFF?
        Hide
        Scott Chen added a comment -

        Tsz Wo: Good catch. Thanks. I will update the patch.

        Show
        Scott Chen added a comment - Tsz Wo: Good catch. Thanks. I will update the patch.
        Scott Chen made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Scott Chen made changes -
        Attachment MAPREDUCE-2302.3.txt [ 12472379 ]
        Hide
        Scott Chen added a comment -

        Updated the patch to address Nicholas's comment.

        Show
        Scott Chen added a comment - Updated the patch to address Nicholas's comment.
        Scott Chen made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Tsz Wo Nicholas Sze added a comment -

        +1 patch looks good.

        Show
        Tsz Wo Nicholas Sze added a comment - +1 patch looks good.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12472379/MAPREDUCE-2302.3.txt
        against trunk revision 1075670.

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 3 new or modified tests.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed core unit tests.

        -1 contrib tests. The patch failed contrib unit tests.

        +1 system test framework. The patch passed system test framework compile.

        Test results: https://hudson.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/110//testReport/
        Findbugs warnings: https://hudson.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/110//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
        Console output: https://hudson.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/110//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12472379/MAPREDUCE-2302.3.txt against trunk revision 1075670. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed core unit tests. -1 contrib tests. The patch failed contrib unit tests. +1 system test framework. The patch passed system test framework compile. Test results: https://hudson.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/110//testReport/ Findbugs warnings: https://hudson.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/110//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: https://hudson.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/110//console This message is automatically generated.
        Hide
        Scott Chen added a comment -

        I just committed this. Thank you very much for the review, Nicholas

        Show
        Scott Chen added a comment - I just committed this. Thank you very much for the review, Nicholas
        Scott Chen made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Fix Version/s 0.23.0 [ 12315570 ]
        Resolution Fixed [ 1 ]
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #631 (See https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/631/)

        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #631 (See https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/631/ )
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #643 (See https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/643/)

        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #643 (See https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/643/ )
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open In Progress In Progress
        2m 58s 2 Scott Chen 01/Mar/11 21:33
        In Progress In Progress Patch Available Patch Available
        14s 2 Scott Chen 01/Mar/11 21:33
        Patch Available Patch Available Open Open
        26d 3h 5m 2 Scott Chen 02/Mar/11 01:18
        Open Open Patch Available Patch Available
        11m 4s 1 Scott Chen 02/Mar/11 01:29
        Patch Available Patch Available Resolved Resolved
        20h 20m 1 Scott Chen 02/Mar/11 21:49
        Resolved Resolved Closed Closed
        257d 2h 59m 1 Arun C Murthy 15/Nov/11 00:49

          People

          • Assignee:
            Scott Chen
            Reporter:
            Scott Chen
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development