Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13272

DataNodeHttpServer to have configurable HttpServer2 threads

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.2
    • Component/s: datanode
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      In HDFS-7279, the Jetty server on the DataNode was hard-coded to use 10 threads. In addition to the possibility of this being too few threads, it is much higher than necessary in resource constrained environments such as MiniDFSCluster. To avoid compatibility issues, rather than using HttpServer2#HTTP_MAX_THREADS directly, we can introduce a new configuration for the DataNode's thread pool size.

        Attachments

        1. HDFS-13272-branch-2.000.patch
          4 kB
          Erik Krogen
        2. HDFS-13272-branch-2.001.patch
          3 kB
          Erik Krogen
        3. testout-branch-2
          387 kB
          Erik Krogen
        4. testout-HDFS-13272.001
          161 kB
          Erik Krogen

          Issue Links

            Activity

              People

              • Assignee:
                xkrogen Erik Krogen
                Reporter:
                xkrogen Erik Krogen
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: