Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7279

Use netty to implement DatanodeWebHdfsMethods

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.7.0
    • Component/s: datanode, webhdfs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently the DN implements all related webhdfs functionality using jetty. As the current jetty version the DN used (jetty 6) lacks of fine-grained buffer and connection management, DN often suffers from long latency and OOM when its webhdfs component is under sustained heavy load.

      This jira proposes to implement the webhdfs component in DN using netty, which can be more efficient and allow more finer-grain controls on webhdfs.

        Attachments

        1. HDFS-7279.013.patch
          62 kB
          Haohui Mai
        2. HDFS-7279.012.patch
          62 kB
          Haohui Mai
        3. HDFS-7279.011.patch
          62 kB
          Haohui Mai
        4. HDFS-7279.010.patch
          58 kB
          Haohui Mai
        5. HDFS-7279.009.patch
          57 kB
          Haohui Mai
        6. HDFS-7279.008.patch
          57 kB
          Haohui Mai
        7. HDFS-7279.007.patch
          58 kB
          Haohui Mai
        8. HDFS-7279.006.patch
          58 kB
          Haohui Mai
        9. HDFS-7279.005.patch
          57 kB
          Haohui Mai
        10. HDFS-7279.004.patch
          57 kB
          Haohui Mai
        11. HDFS-7279.003.patch
          58 kB
          Haohui Mai
        12. HDFS-7279.002.patch
          58 kB
          Haohui Mai
        13. HDFS-7279.001.patch
          58 kB
          Haohui Mai
        14. HDFS-7279.000.patch
          42 kB
          Haohui Mai

          Issue Links

            Activity

              People

              • Assignee:
                wheat9 Haohui Mai
                Reporter:
                wheat9 Haohui Mai
              • Votes:
                0 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: