Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: 0.20.1, 0.21.0
    • Fix Version/s: None
    • Component/s: io
    • Labels:
    • Environment:

      Hadoop 0.20.1, Centos

    • Release Note:
      Found a NullPointerException with MapWritable. The root cause is the counter newClasses in AbstractMapWritable is allowed to get out of sync with the id to class mapping tables when addToMap(Class) is called.

      Description

      We have encountered a NullPointerException when we use MapWritable with custom Writable objects.

      The root cause is the counter newClasses in AbstractMapWritable is allowed to get out of sync with the id to class mapping tables when addToMap(Class) is called. We have a patch to AbstractMapWritable.addToMap(Class) that handles the case when newClasses gets out of sync with the id to class mapping tables and adds a serialization optimization to minimize the number of class names to write out per MapWritable object.

      1. HADOOP-7021.02.patch
        3 kB
        Ravi Prakash
      2. HADOOP-7021.patch
        3 kB
        John Lee
      3. HADOOP-7021.patch
        3 kB
        John Lee
      4. HADOOP-7021.patch
        3 kB
        John Lee
      5. HADOOP-7021.patch
        3 kB
        tom pierce

        Activity

        Ravi Prakash made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Ravi Prakash made changes -
        Labels BB2015-05-RFC
        Ravi Prakash made changes -
        Attachment HADOOP-7021.02.patch [ 12731612 ]
        Ravi Prakash made changes -
        Labels BB2015-05-RFC
        Ray Chiang made changes -
        Labels BB2015-05-RFC
        Ray Chiang made changes -
        Labels BB2015-05-TBR
        Allen Wittenauer made changes -
        Labels BB2015-05-TBR
        Allen Wittenauer made changes -
        Fix Version/s 0.20.1 [ 12313866 ]
        John Lee made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        John Lee made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        John Lee made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        John Lee made changes -
        Attachment HADOOP-7021.patch [ 12503833 ]
        John Lee made changes -
        Status In Progress [ 3 ] Open [ 1 ]
        Doug Cutting made changes -
        Assignee John Lee [ jlee@mindset-media.com ]
        John Lee made changes -
        Status Patch Available [ 10002 ] In Progress [ 3 ]
        John Lee made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        John Lee made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        John Lee made changes -
        Attachment HADOOP-7021.patch [ 12490322 ]
        John Lee made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        John Lee made changes -
        Attachment HADOOP-7021.patch [ 12488875 ]
        John Lee made changes -
        Attachment HADOOP-7021.patch [ 12488854 ]
        John Lee made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        John Lee made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        John Lee made changes -
        Attachment HADOOP-7021.patch [ 12488471 ]
        John Lee made changes -
        Attachment TestMapWritableNPE.java [ 12458908 ]
        John Lee made changes -
        Attachment AbstractMapWritable.java [ 12458910 ]
        John Lee made changes -
        Attachment AbstractMapWritable.diff [ 12458909 ]
        John Lee made changes -
        Attachment HADOOP-7021.patch [ 12488854 ]
        John Lee made changes -
        Attachment HADOOP-7021.patch [ 12488471 ]
        John Lee made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        tom pierce made changes -
        Affects Version/s 0.21.0 [ 12313563 ]
        tom pierce made changes -
        Attachment HADOOP-7021.patch [ 12466768 ]
        John Lee made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Release Note Found a NullPointerException with MapWritable. The root cause is the counter newClasses in AbstractMapWritable is allowed to get out of sync with the id to class mapping tables when addToMap(Class) is called.
        John Lee made changes -
        Field Original Value New Value
        Attachment TestMapWritableNPE.java [ 12458908 ]
        Attachment AbstractMapWritable.diff [ 12458909 ]
        Attachment AbstractMapWritable.java [ 12458910 ]
        John Lee created issue -

          People

          • Assignee:
            John Lee
            Reporter:
            John Lee
          • Votes:
            1 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

            • Created:
              Updated:

              Development