Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-1964

OpenSSL locks create scalability bottleneck

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.3.0
    • Fix Version/s: 1.4.0
    • Component/s: impala, perf, rpc, security
    • Labels:
      None

      Description

      I'm running a concurrent workload against impala and took a pstack where I noticed that most of the kudu threads are stuck in a stack that looks like:
      #6 0x000000348d6e807b in ERR_get_state () from /usr/lib64/libcrypto.so.10
      #7 0x000000348d6e881d in ERR_clear_error () from /usr/lib64/libcrypto.so.10
      #8 0x00007f33fdecb834 in kudu::security::TlsHandshake::Continue(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> >*) () from /opt/cloudera/parcels/CDH-5.11.0-1.cdh5.11.0.p0.16/lib/impala/lib/libkudu_client.so.0

      https://konradzemek.com/2015/08/16/asio-ssl-and-scalability/ notes the same issue but unfortnuately has no good solution aside from switching to BoringSSL

        Attachments

          Activity

            People

            • Assignee:
              tlipcon Todd Lipcon
              Reporter:
              tlipcon Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: