[MESOS-7400] The mesos master crashes due to an incorrect invariant check in the decoder.

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 1.2.1, 1.3.0
• Target Version/s: 1.2.1, 1.3.0
• Assignee: Anindya Sinha
• Reporter: Anindya Sinha
• Shepherd: Anand Mazumdar
• Created: 18/Apr/17 16:59
• Updated: 26/Apr/17 16:52
• Resolved: 21/Apr/17 16:48

Description

F0401 15:14:20.272156 231760 decoder.hpp:1006] CHECK_SOME(decoder->writer): is NONE

partial gdb stack trace captured on the Mesos master:

(gdb) bt
#0  0x00007f4948b715e5 in raise () from /lib64/libc.so.6
#1  0x00007f4948b72dc5 in abort () from /lib64/libc.so.6
#2  0x00007f494b1f1ef6 in google::DumpStackTraceAndExit () at src/utilities.cc:147
#3  0x00007f494b1e98dd in google::LogMessage::Fail () at src/logging.cc:1458
#4  0x00007f494b1eb66d in google::LogMessage::SendToLog (this=Unhandled dwarf expression opcode 0xf3
) at src/logging.cc:1412
#5  0x00007f494b1e9462 in google::LogMessage::Flush (this=0x7f49323ddb10) at src/logging.cc:1281
#6  0x00007f494b1ec049 in google::LogMessageFatal::~LogMessageFatal (this=Unhandled dwarf expression opcode 0xf3
) at src/logging.cc:1984
#7  0x00007f494b0dee77 in ~_CheckFatal (p=Unhandled dwarf expression opcode 0xf3
) at ../../../3rdparty/stout/include/stout/check.hpp:164
#8  process::StreamingRequestDecoder::on_message_complete (p=Unhandled dwarf expression opcode 0xf3
) at ../../../3rdparty/libprocess/src/decoder.hpp:1006
#9  0x00007f494b1c1d05 in http_parser_execute (parser=0x7f49204642c8, settings=Unhandled dwarf expression opcode 0xf3
)
    at http-parser-2.6.2/http_parser.c:1845
#10 0x00007f494b15017e in decode (length=Unhandled dwarf expression opcode 0xf3
) at ../../../3rdparty/libprocess/src/decoder.hpp:793
#11 process::internal::decode_recv (length=Unhandled dwarf expression opcode 0xf3
) at ../../../3rdparty/libprocess/src/process.cpp:845