Hadoop Common
  1. Hadoop Common
  2. HADOOP-7328

When a serializer class is missing, return null, not throw an NPE.

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.2
    • Fix Version/s: 0.23.0
    • Component/s: io
    • Labels:
    • Hadoop Flags:
      Reviewed
    • Tags:
      logging, exception, serializers, serializationfactory

      Description

      When you have a key/value class that's non Writable and you forget to attach io.serializers for the same, an NPE is thrown by the tasks with no information on why or what's missing and what led to it. I think a better exception can be thrown by SerializationFactory instead of an NPE when a class is not found accepted by any of the loaded ones.

      1. 0.20-security-HADOOP-7328.r7.diff
        3 kB
        Harsh J
      2. HADOOP-7328.r7.diff
        6 kB
        Harsh J
      3. 0.23-HADOOP-7328.r7.diff
        6 kB
        Harsh J
      4. HADOOP-7328.r6.diff
        5 kB
        Harsh J
      5. HADOOP-7328.r5.diff
        5 kB
        Harsh J
      6. HADOOP-7328.r4.diff
        4 kB
        Harsh J
      7. HADOOP-7328.r4.diff
        4 kB
        Harsh J
      8. HADOOP-7328.r3.diff
        4 kB
        Harsh J
      9. HADOOP-7328.r2.diff
        3 kB
        Harsh J
      10. HADOOP-7328.r1.diff
        1 kB
        Harsh J

        Issue Links

          Activity

          Harsh J created issue -
          Harsh J made changes -
          Field Original Value New Value
          Attachment HADOOP-7328.r1.diff [ 12480231 ]
          Harsh J made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Harsh J made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Harsh J made changes -
          Link This issue blocks MAPREDUCE-2584 [ MAPREDUCE-2584 ]
          Harsh J made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Release Note Improve SerializationFactory's handling of cases where a serializer isn't found given a class.
          Harsh J made changes -
          Attachment HADOOP-7328.r2.diff [ 12482273 ]
          Harsh J made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Harsh J made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Harsh J made changes -
          Attachment HADOOP-7328.r3.diff [ 12482787 ]
          Harsh J made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Harsh J made changes -
          Attachment HADOOP-7328.r4.diff [ 12483864 ]
          Harsh J made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Harsh J made changes -
          Attachment HADOOP-7328.r4.diff [ 12483867 ]
          Harsh J made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Harsh J made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Harsh J made changes -
          Attachment HADOOP-7328.r5.diff [ 12487008 ]
          Harsh J made changes -
          Attachment HADOOP-7328.r6.diff [ 12487013 ]
          Harsh J made changes -
          Summary Give more information about a missing Serializer class When a serializer class is missing, return null, not throw an NPE.
          Harsh J made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Harsh J made changes -
          Attachment HADOOP-7328.r7.diff [ 12492919 ]
          Attachment 0.23-HADOOP-7328.r7.diff [ 12492920 ]
          Attachment 0.22-HADOOP-7328.r7.diff [ 12492921 ]
          Harsh J made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Harsh J made changes -
          Attachment HADOOP-7328.r7.diff [ 12492919 ]
          Harsh J made changes -
          Attachment HADOOP-7328.r7.diff [ 12492930 ]
          Harsh J made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Harsh J made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Todd Lipcon made changes -
          Fix Version/s 0.24.0 [ 12317652 ]
          Harsh J made changes -
          Attachment 0.20-security-HADOOP-7328.r7.diff [ 12493899 ]
          Harsh J made changes -
          Attachment 0.22-HADOOP-7328.r7.diff [ 12492921 ]
          Arun C Murthy made changes -
          Fix Version/s 0.23.0 [ 12315569 ]
          Harsh J made changes -
          Target Version/s 1.1.0 [ 12316501 ]
          Harsh J made changes -
          Target Version/s 1.1.0 [ 12316501 ] 0.23.1, 1.1.0 [ 12318884, 12316501 ]
          Harsh J made changes -
          Fix Version/s 0.23.0 [ 12315569 ]
          Fix Version/s 0.24.0 [ 12317652 ]
          Target Version/s 1.1.0, 0.23.1 [ 12316501, 12318884 ]
          Harsh J made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Harsh J made changes -
          Hadoop Flags Reviewed [ 10343 ]
          Gavin made changes -
          Link This issue blocks MAPREDUCE-2584 [ MAPREDUCE-2584 ]
          Gavin made changes -
          Link This issue is depended upon by MAPREDUCE-2584 [ MAPREDUCE-2584 ]

            People

            • Assignee:
              Harsh J
              Reporter:
              Harsh J
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development