Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4974

Optimising the LineRecordReader initialize() method

    Details

      Description

      I found there is a a scope of optimizing the code, over initialize() if we have compressionCodecs & codec instantiated only if its a compressed input.
      Mean while Gelesh George Omathil, added if we could avoid the null check of key & value. This would time save, since for every next key value generation, null check is done. The intention being to instantiate only once and avoid NPE as well. Hope both could be met if initialize key & value over initialize() method. We both have worked on it.

      1. MAPREDUCE-4974.2.patch
        12 kB
        Arun A K
      2. MAPREDUCE-4974.3.patch
        3 kB
        Gelesh
      3. MAPREDUCE-4974.4.patch
        2 kB
        Gelesh
      4. MAPREDUCE-4974.5.patch
        3 kB
        Gelesh

        Activity

        Arun A K created issue -
        Gelesh made changes -
        Field Original Value New Value
        Status Open [ 1 ] Patch Available [ 10002 ]
        Target Version/s 1.0.0, 1.0.4, 1.1.1, 2.0.0-alpha, 2.0.1-alpha, 0.23.4, 0.23.5 [ 12318240, 12323325, 12321660, 12320354, 12322466, 12323264, 12323312 ] 0.23.5, 0.23.4, 2.0.1-alpha, 2.0.0-alpha, 1.1.1, 1.0.4, 1.0.0 [ 12323312, 12323264, 12322466, 12320354, 12321660, 12323325, 12318240 ]
        Assignee Arun A K [ ak.arun@aol.com ] Gelesh [ gelesh ]
        Gelesh made changes -
        Attachment MAPREDUCE-4974.1.patch [ 12567831 ]
        Arun A K made changes -
        Summary optimising the LineRecordReader initialize method Optimising the LineRecordReader initialize() method
        Karthik Kambatla made changes -
        Fix Version/s 0.20.204.0 [ 12316318 ]
        Fix Version/s 0.24.0 [ 12317654 ]
        Target Version/s 1.0.0, 1.0.4, 1.1.1, 2.0.0-alpha, 2.0.1-alpha, 0.23.4, 0.23.5 [ 12318240, 12323325, 12321660, 12320354, 12322466, 12323264, 12323312 ] 0.23.5, 0.23.4, 2.0.1-alpha, 2.0.0-alpha, 1.1.1, 1.0.4, 1.0.0 [ 12323312, 12323264, 12322466, 12320354, 12321660, 12323325, 12318240 ]
        Arun A K made changes -
        Attachment MAPREDUCE-4974.2.patch [ 12568811 ]
        Gelesh made changes -
        Attachment MAPREDUCE-4974.3.patch [ 12568943 ]
        Gelesh made changes -
        Attachment MAPREDUCE-4974.4.patch [ 12570453 ]
        Gelesh made changes -
        Attachment MAPREDUCE-4974.1.patch [ 12567831 ]
        Gelesh made changes -
        Rank Ranked higher
        Robert Joseph Evans made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Target Version/s 1.0.0, 1.0.4, 1.1.1, 2.0.0-alpha, 2.0.1-alpha, 0.23.4, 0.23.5 [ 12318240, 12323325, 12321660, 12320354, 12322466, 12323264, 12323312 ] 0.23.5, 0.23.4, 2.0.1-alpha, 2.0.0-alpha, 1.1.1, 1.0.4, 1.0.0 [ 12323312, 12323264, 12322466, 12320354, 12321660, 12323325, 12318240 ]
        Fix Version/s 0.23.7 [ 12323954 ]
        Fix Version/s 2.0.5-beta [ 12324032 ]
        Resolution Fixed [ 1 ]
        Robert Joseph Evans made changes -
        Resolution Fixed [ 1 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        Gelesh made changes -
        Status Reopened [ 4 ] Patch Available [ 10002 ]
        Target Version/s 1.0.0, 1.0.4, 1.1.1, 2.0.0-alpha, 2.0.1-alpha, 0.23.4, 0.23.5 [ 12318240, 12323325, 12321660, 12320354, 12322466, 12323264, 12323312 ] 0.23.5, 0.23.4, 2.0.1-alpha, 2.0.0-alpha, 1.1.1, 1.0.4, 1.0.0 [ 12323312, 12323264, 12322466, 12320354, 12321660, 12323325, 12318240 ]
        Gelesh made changes -
        Attachment MAPREDUCE-4974.5.patch [ 12576759 ]
        Robert Joseph Evans made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Target Version/s 1.0.0, 1.0.4, 1.1.1, 2.0.0-alpha, 2.0.1-alpha, 0.23.4, 0.23.5 [ 12318240, 12323325, 12321660, 12320354, 12322466, 12323264, 12323312 ] 0.23.5, 0.23.4, 2.0.1-alpha, 2.0.0-alpha, 1.1.1, 1.0.4, 1.0.0 [ 12323312, 12323264, 12322466, 12320354, 12321660, 12323325, 12318240 ]
        Fix Version/s trunk [ 12320360 ]
        Fix Version/s 0.23.7 [ 12323954 ]
        Resolution Fixed [ 1 ]
        Sachin Jose made changes -
        Affects Version/s 0.23.5 [ 12323312 ]
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Gelesh
            Reporter:
            Arun A K
          • Votes:
            1 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

            • Due:
              Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 1h
              1h
              Remaining:
              Remaining Estimate - 1h
              1h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development