Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-9081

Handling GRPC/Netty back pressure when streaming containers for replication.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None

    Description

      Replication sends messages faster than the network/receiver can consume. This results in many messages being queued by GRPC/Netty and the amount allocated memory surges and results in OOME. 

      Attachments

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. HDDS-9134 GRPC based replication can get stuck forever if the receiver is not available

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. RATIS-1868 Handling Netty back pressure when streaming ratis log

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. RATIS-2189 Use ByteBufAllocator#ioBuffer in NettyDataStreamUtils

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Web Link GitHub Pull Request #5118

          Activity

            People

              duongnguyen Duong
              duongnguyen Duong
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: