Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-1964

OpenSSL locks create scalability bottleneck

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.3.0
    • 1.4.0
    • impala, perf, rpc, security
    • None

    Description

      I'm running a concurrent workload against impala and took a pstack where I noticed that most of the kudu threads are stuck in a stack that looks like:
      #6 0x000000348d6e807b in ERR_get_state () from /usr/lib64/libcrypto.so.10
      #7 0x000000348d6e881d in ERR_clear_error () from /usr/lib64/libcrypto.so.10
      #8 0x00007f33fdecb834 in kudu::security::TlsHandshake::Continue(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> >*) () from /opt/cloudera/parcels/CDH-5.11.0-1.cdh5.11.0.p0.16/lib/impala/lib/libkudu_client.so.0

      https://konradzemek.com/2015/08/16/asio-ssl-and-scalability/ notes the same issue but unfortnuately has no good solution aside from switching to BoringSSL

      Attachments

        Activity

          People

            tlipcon Todd Lipcon
            tlipcon Todd Lipcon
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: