Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11219 [Umbrella] Upgrade to netty 4
  3. HADOOP-15327

Upgrade MR ShuffleHandler to use Netty4

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      This way, we can remove the dependencies on the netty3 (jboss.netty)

      Attachments

        1. getMapOutputInfo_BlockingOperationException_awaitUninterruptibly.log
          11 kB
          Szilard Nemeth
        2. hades-results-20221108.zip
          30.95 MB
          Szilard Nemeth
        3. HADOOP-15327.001.patch
          94 kB
          Szilard Nemeth
        4. HADOOP-15327.002.patch
          93 kB
          Szilard Nemeth
        5. HADOOP-15327.003.patch
          91 kB
          Szilard Nemeth
        6. HADOOP-15327.004.patch
          104 kB
          Szilard Nemeth
        7. HADOOP-15327.005.patch
          124 kB
          Szilard Nemeth
        8. HADOOP-15327.005.patch
          124 kB
          Szilard Nemeth
        9. testfailure-testMapFileAccess-emptyresponse.zip
          42 kB
          Szilard Nemeth
        10. testfailure-testReduceFromPartialMem.zip
          210 kB
          Szilard Nemeth

        Issue Links

          causes

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-7431 ShuffleHandler is not working correctly in SSL mode after the Netty 4 upgrade

          • Major - Major loss of function.
          • Resolved
          is related to

          Task - A task that needs to be done. HADOOP-18602 Remove netty3 dependency

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. TEZ-4460 Read timed out in shuffle handler - incorrect usage of EMPTY_LAST_CONTENT and channel write

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. HBASE-28188 Narrow the netty3 dependency scope

          • Major - Major loss of function.
          • Open
          links to

          Web Link GitHub Pull Request #3259

          Activity

            People

              snemeth Szilard Nemeth
              xyao Xiaoyu Yao
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 11.5h
                  11.5h