Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Invalid
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Currently, JVM-reuse is across tasks of same type of the same job, i.e. JVMs are kind of marked as map-JVMs and reduce JVMs. May be we can reuse JVMs across tasks of different types but of the same job.

      1. 5425.1.patch
        30 kB
        Devaraj Das

        Issue Links

          Activity

          Vinod Kumar Vavilapalli created issue -
          Hide
          Devaraj Das added a comment -

          Straightforward patch. The patch removes the JvmManager's internal class JvmManagerForType and all the methods defined there are now accessible via JvmManager. The patch looks big mainly because of indentation changes.

          Show
          Devaraj Das added a comment - Straightforward patch. The patch removes the JvmManager's internal class JvmManagerForType and all the methods defined there are now accessible via JvmManager. The patch looks big mainly because of indentation changes.
          Devaraj Das made changes -
          Field Original Value New Value
          Attachment 5425.1.patch [ 12406992 ]
          Devaraj Das made changes -
          Assignee Devaraj Das [ devaraj ]
          Fix Version/s 0.21.0 [ 12313563 ]
          Affects Version/s 0.19.0 [ 12313211 ]
          Devaraj Das made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Devaraj Das made changes -
          Link This issue blocks HADOOP-4421 [ HADOOP-4421 ]
          Hide
          Devaraj Das added a comment -

          Vinod pointed out that we cannot reuse the same jvm across multiple task types at least for the reason that one might want to specify different heap sizes for the map and reduce jvms.

          Show
          Devaraj Das added a comment - Vinod pointed out that we cannot reuse the same jvm across multiple task types at least for the reason that one might want to specify different heap sizes for the map and reduce jvms.
          Devaraj Das made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Owen O'Malley made changes -
          Project Hadoop Common [ 12310240 ] Hadoop Map/Reduce [ 12310941 ]
          Key HADOOP-5425 MAPREDUCE-29
          Affects Version/s 0.19.0 [ 12313211 ]
          Component/s mapred [ 12310690 ]
          Fix Version/s 0.21.0 [ 12313563 ]
          Hide
          Harsh J added a comment -

          Given the feature of different heap sizes per task type, this does not make sense to have anymore.

          Show
          Harsh J added a comment - Given the feature of different heap sizes per task type, this does not make sense to have anymore.
          Harsh J made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Invalid [ 6 ]

            People

            • Assignee:
              Devaraj Das
              Reporter:
              Vinod Kumar Vavilapalli
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development