[IMPALA-2557] Kerberized hs2/impyla randomly fails: "OverflowError: signed integer is greater than maximum"

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Cannot Reproduce
• Affects Version/s: Impala 2.3.0
• Component/s: Clients
• Labels: stress
• Target Version: Product Backlog
• Assignee: Unassigned
• Reporter: casey
• Created: 15/Oct/15 19:38
• Updated: 19/Jun/20 19:45
• Resolved: 19/Jun/20 19:45

Description

The error below comes up rarely, maybe 1/5000 queries. I haven't investigated this. The error could be either in the server or the client.

03:57:11 16583 140231084865280 ERROR:concurrent_select[705]:Non-mem limit error for query with id e44a41527fce61e8:bea7014c6146dfa2: CancelOperation failed: unknown result
Traceback (most recent call last):
  File "tests/stress/concurrent_select.py", line 684, in _check_for_mem_limit_exceeded
    report.profile = cursor.get_profile()
  File "/var/lib/jenkins/workspace/Impala-Stress-Test-Kerberized/Impala/infra/python/env/local/lib/python2.7/site-packages/impala/hiveserver2.py", line 373, in get_profile
    self.service, self._last_operation_handle, self.session_handle)
  File "/var/lib/jenkins/workspace/Impala-Stress-Test-Kerberized/Impala/infra/python/env/local/lib/python2.7/site-packages/impala/hiveserver2.py", line 916, in get_profile
    resp = service.GetRuntimeProfile(req)
  File "/var/lib/jenkins/workspace/Impala-Stress-Test-Kerberized/Impala/infra/python/env/local/lib/python2.7/site-packages/impala/_thrift_gen/ImpalaService/ImpalaHiveServer2Service.py", line 77, in GetRuntimeProfile
    return self.recv_GetRuntimeProfile()
  File "/var/lib/jenkins/workspace/Impala-Stress-Test-Kerberized/Impala/infra/python/env/local/lib/python2.7/site-packages/impala/_thrift_gen/ImpalaService/ImpalaHiveServer2Service.py", line 88, in recv_GetRuntimeProfile
    (fname, mtype, rseqid) = self._iprot.readMessageBegin()
  File "/var/lib/jenkins/workspace/Impala-Stress-Test-Kerberized/Impala/thirdparty/hive-1.1.0-cdh5.7.0-SNAPSHOT/lib/py/thrift/protocol/TBinaryProtocol.py", line 137, in readMessageBegin
    name = self.trans.readAll(sz)
  File "/var/lib/jenkins/workspace/Impala-Stress-Test-Kerberized/Impala/thirdparty/hive-1.1.0-cdh5.7.0-SNAPSHOT/lib/py/thrift/transport/TTransport.py", line 58, in readAll
    chunk = self.read(sz-have)
  File "/var/lib/jenkins/workspace/Impala-Stress-Test-Kerberized/Impala/infra/python/env/local/lib/python2.7/site-packages/thrift_sasl/__init__.py", line 159, in read
    self._read_frame()
  File "/var/lib/jenkins/workspace/Impala-Stress-Test-Kerberized/Impala/infra/python/env/local/lib/python2.7/site-packages/thrift_sasl/__init__.py", line 176, in _read_frame
    decoded = read_all_compat(self._trans, length)
  File "/var/lib/jenkins/workspace/Impala-Stress-Test-Kerberized/Impala/infra/python/env/local/lib/python2.7/site-packages/thrift_sasl/six.py", line 31, in <lambda>
    read_all_compat = lambda trans, sz: trans.readAll(sz)
  File "/var/lib/jenkins/workspace/Impala-Stress-Test-Kerberized/Impala/thirdparty/hive-1.1.0-cdh5.7.0-SNAPSHOT/lib/py/thrift/transport/TTransport.py", line 58, in readAll
    chunk = self.read(sz-have)
  File "/var/lib/jenkins/workspace/Impala-Stress-Test-Kerberized/Impala/thirdparty/hive-1.1.0-cdh5.7.0-SNAPSHOT/lib/py/thrift/transport/TSocket.py", line 92, in read
    buff = self.handle.recv(sz)
OverflowError: signed integer is greater than maximum