Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-9843

Ozone client high memory (heap) utilization

    XMLWordPrintableJSON

Details

    Description

      Ozone client high memory utilization during write - should use pooled direct buffer for chunks

      Found this issue when working on S3.

      S3G memory footprint is too high when reading/writing small objects.

      Ran a test to write thousand of small (400 bytes) objects per seconds and memory utilization and gc is too high.

      This is issue is not S3 specific, but happens on ozone-client in general.

      Attachments

        1. s3_heap_metric.png
          1.43 MB
          Duong
        2. image-2023-12-05-16-35-37-893.png
          1.37 MB
          Duong
        3. image-2023-12-05-16-36-17-726.png
          1.37 MB
          Duong
        4. buffer_allocation.png
          3.21 MB
          Duong

        Issue Links

          Activity

            People

              duongnguyen Duong
              duongnguyen Duong
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: