Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-7283

Consider backing off before retrying RPC

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Distributed Exec
    • None
    • ghx-label-1

    Description

      stiga-huang suggested here https://gerrit.cloudera.org/#/c/10744/11/be/src/service/client-request-state.cc@628

      What about sleep several seconds before the next retry like this?

      for (int i = 0; i < 3; ++i, sleep(3))

      Usually it will increase success rate if there're network issues or the target server is stuck temporarily.

      This seems worth considering but I don't have the knowledge to really evaluate it

      This would likely involve:

      • For KRPC, using the backoff logic in IMPALA-8143 for all RPCs, maybe doing exponential backoff sometimes
      • For thrift, adding backoff logic like this to the thrift version of DoRpcWithRetry.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              tarmstrong Tim Armstrong
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: