Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-1529

kudu-tserver cannot restart after server crash due to partial write .

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Duplicate
    • Affects Version/s: 0.9.1
    • Fix Version/s: n/a
    • Component/s: None
    • Labels:
      None

      Description

      After server crash , kudu-tserver cannot be restarted successfully.
      From fatal log , there is a check failed:

      Check failed: schema.has_column_ids()

      and backtrace:
      #0 0x0000003296632925 in raise () from /export/servers/kudu/0.9-rc/lib64/libc.so.6
      #1 0x0000003296634105 in abort () from /export/servers/kudu/0.9-rc/lib64/libc.so.6
      #2 0x0000000000797196 in google::DumpStackTraceAndExit () at src/utilities.cc:150
      #3 0x000000000078d02d in google::LogMessage::Fail () at src/logging.cc:1478
      #4 0x000000000078ef2d in google::LogMessage::SendToLog (this=<optimized out>) at src/logging.cc:1432
      #5 0x000000000078cb69 in google::LogMessage::Flush (this=this@entry=0x7f39869edd10) at src/logging.cc:1301
      #6 0x000000000078f9cf in google::LogMessageFatal::~LogMessageFatal (this=0x7f39869edd10, __in_chrg=<optimized out>) at src/logging.cc:2013
      #7 0x00000000008be7a7 in kudu::tablet::MemRowSet::MemRowSet (this=0x5b11c960, id=<optimized out>, schema=..., log_anchor_registry=0x324f640, parent_tracker=...)
      at /export/ldb/kudu_build/kudu-gitlab/src/kudu/tablet/memrowset.cc:102
      #8 0x0000000000867ce9 in kudu::tablet::Tablet::RewindSchemaForBootstrap (this=0x5d2ccdc0, new_schema=..., schema_version=<optimized out>)
      at /export/ldb/kudu_build/kudu-gitlab/src/kudu/tablet/tablet.cc:870
      #9 0x000000000087d6a4 in kudu::tablet::TabletBootstrap::PlaySegments (this=this@entry=0x7f39869ee590, consensus_info=consensus_info@entry=0x7f39869ee990)
      at /export/ldb/kudu_build/kudu-gitlab/src/kudu/tablet/tablet_bootstrap.cc:1023
      #10 0x000000000087ef56 in kudu::tablet::TabletBootstrap::Bootstrap (this=this@entry=0x7f39869ee590, rebuilt_tablet=rebuilt_tablet@entry=0x7f39869ee8a0,
      rebuilt_log=rebuilt_log@entry=0x7f39869ee710, consensus_info=consensus_info@entry=0x7f39869ee990) at /export/ldb/kudu_build/kudu-gitlab/src/kudu/tablet/tablet_bootstrap.cc:498
      #11 0x000000000087f684 in kudu::tablet::BootstrapTablet (meta=..., clock=..., mem_tracker=..., metric_registry=metric_registry@entry=0x31a0dc0, listener=listener@entry=0x598efce0,
      rebuilt_tablet=0x7f39869ee8a0, rebuilt_log=0x7f39869ee710, log_anchor_registry=..., consensus_info=0x7f39869ee990)
      at /export/ldb/kudu_build/kudu-gitlab/src/kudu/tablet/tablet_bootstrap.cc:395
      #12 0x000000000075321f in kudu::tserver::TSTabletManager::OpenTablet (this=0x3162160, meta=..., deleter=...) at /export/ldb/kudu_build/kudu-gitlab/src/kudu/tserver/ts_tablet_manager.cc:647
      #13 0x0000000001901c1e in boost::function0<void>::operator() (this=<optimized out>) at /usr/local/include/boost/function/function_template.hpp:767
      #14 kudu::FunctionRunnable::Run (this=<optimized out>) at /export/ldb/kudu_build/kudu-gitlab/src/kudu/util/threadpool.cc:48
      #15 kudu::ThreadPool::DispatchThread (this=0x31d9b00, permanent=false) at /export/ldb/kudu_build/kudu-gitlab/src/kudu/util/threadpool.cc:343
      #16 0x00000000018fc79a in boost::function0<void>::operator() (this=0x521e56e8) at /usr/local/include/boost/function/function_template.hpp:767
      #17 kudu::Thread::SuperviseThread (arg=0x521e56c0) at /export/ldb/kudu_build/kudu-gitlab/src/kudu/util/thread.cc:586
      #18 0x0000003296a079d1 in start_thread () from /export/servers/kudu/0.9-rc/lib64/libpthread.so.0
      #19 0x00000032966e8b6d in clone () from /export/servers/kudu/0.9-rc/lib64/libc.so.6

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                bruceSz zhangsong
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: