Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7240 Scaling HDFS
  3. HDFS-12745

Ozone: XceiverClientManager should cache objects based on pipeline name

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • HDFS-7240
    • HDFS-7240
    • ozone
    • None

    Description

      With just the standalone pipeline, a new pipeline was created for each and every container.
      This code can be optimized so that pipelines are craeted less frequently. Caching using pipeline names will help with Ratis clients as well.

      a) Remove Container name from Pipeline object.
      b) XceiverClientManager should cache objects based on pipeline name
      c) XceiverClient and XceiverServer should be renamed to XceiverClientStandAlone & XceiverServerRatis
      d) StandAlone pipeline should have notion of re-using pipeline objects.

      Attachments

        1. HDFS-12745-HDFS-7240.001.patch
          48 kB
          Mukul Kumar Singh
        2. HDFS-12745-HDFS-7240.002.patch
          63 kB
          Mukul Kumar Singh
        3. HDFS-12745-HDFS-7240.003.patch
          60 kB
          Mukul Kumar Singh
        4. HDFS-12745-HDFS-7240.004.patch
          60 kB
          Mukul Kumar Singh
        5. HDFS-12745-HDFS-7240.005.patch
          60 kB
          Mukul Kumar Singh
        6. HDFS-12745-HDFS-7240.006.patch
          62 kB
          Mukul Kumar Singh
        7. HDFS-12745-HDFS-7240.007.patch
          62 kB
          Mukul Kumar Singh

        Issue Links

          Activity

            People

              msingh Mukul Kumar Singh
              msingh Mukul Kumar Singh
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated: