Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4974

Optimising the LineRecordReader initialize() method

    Details

      Description

      I found there is a a scope of optimizing the code, over initialize() if we have compressionCodecs & codec instantiated only if its a compressed input.
      Mean while Gelesh George Omathil, added if we could avoid the null check of key & value. This would time save, since for every next key value generation, null check is done. The intention being to instantiate only once and avoid NPE as well. Hope both could be met if initialize key & value over initialize() method. We both have worked on it.

      1. MAPREDUCE-4974.2.patch
        12 kB
        Arun A K
      2. MAPREDUCE-4974.3.patch
        3 kB
        Gelesh
      3. MAPREDUCE-4974.4.patch
        2 kB
        Gelesh
      4. MAPREDUCE-4974.5.patch
        3 kB
        Gelesh

        Activity

          People

          • Assignee:
            Gelesh
            Reporter:
            Arun A K
          • Votes:
            1 Vote for this issue
            Watchers:
            13 Start watching this issue

            Dates

            • Due:
              Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 1h
              1h
              Remaining:
              Remaining Estimate - 1h
              1h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development