[KUDU-464] client-test: Not implemented: AlterSchema not supported by MemRowSet

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: M4
• Component/s: tablet
• Labels: alter-table
• Assignee: Unassigned
• Reporter: Mike Percy
• Created: 16/Aug/14 10:27
• Updated: 26/Feb/16 13:56
• Resolved: 16/Aug/14 18:21

Description

I have been getting Gerrit test failures lately (happened twice so far) with the following test failure:

I0816 00:13:22.926762  9421 tablet.cc:674] Memstore in-memory size: 1572864 bytes
I0816 00:13:22.926789  9421 tablet.cc:1068] Flush: entering phase 1 (flushing snapshot)
I0816 00:13:22.927570  9421 multi_column_writer.cc:66] Opened CFile writer for column key[uint32 NOT NULL]
I0816 00:13:22.927911  9421 multi_column_writer.cc:66] Opened CFile writer for column string_val[string NULLABLE]
I0816 00:13:22.928526  9336 catalog_manager.cc:1647] client-testtb2 [id=9bef36d076904638a6af4e720d819835] - Alter table completed version=1
I0816 00:13:22.929013  9421 multi_column_writer.cc:66] Opened CFile writer for column non_null_with_default[uint32 NOT NULL]
I0816 00:13:22.929075  9346 catalog_manager.cc:711] Servicing AlterTable request from {real_user=jenkins, eff_user=} at 127.0.0.1:57967: table { table_name: "client-testtb2" } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "new_string_val" type: STRING is_nullable: true encoding: GROUP_VARINT compression: DEFAULT_COMPRESSION } } }
I0816 00:13:22.929298  9421 multi_column_writer.cc:66] Opened CFile writer for column new_col[uint32 NULLABLE]
I0816 00:13:22.930559  9347 catalog_manager.cc:711] Servicing AlterTable request from {real_user=jenkins, eff_user=} at 127.0.0.1:57967: table { table_name: "client-testtb2" } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "new_string_val" type: STRING is_nullable: true encoding: PREFIX_ENCODING compression: DEFAULT_COMPRESSION } } }
I0816 00:13:22.932255  9436 tablet.cc:722] Alter schema from Schema [0:key[uint32 NOT NULL], 2:string_val[string NULLABLE], 3:non_null_with_default[uint32 NOT NULL], 4:new_col[uint32 NULLABLE]] version 1 to Schema [0:key[uint32 NOT NULL], 2:string_val[string NULLABLE], 3:non_null_with_default[uint32 NOT NULL], 4:new_col[uint32 NULLABLE], 5:new_string_val[string NULLABLE]] version 2
I0816 00:13:22.932683  9421 tablet.cc:1098] Flush resulted in no output rows (all input rows were GCed!)  Removing all input rowsets.
W0816 00:13:22.933011  9436 transaction_driver.cc:324] Commit failed in transaction: AlterSchemaTransaction [state=AlterSchemaTransactionState [timestamp=5767877439209619456, schema=Schema [0:key[uint32 NOT NULL], 2:string_val[string NULLABLE], 3:non_null_with_default[uint32 NOT NULL], 4:new_col[uint32 NULLABLE], 5:new_string_val[string NULLABLE]], request=tablet_id: "d15b9a5469bc46829b4fa398b9c757b9" schema { columns { id: 0 name: "key" type: UINT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION } columns { id: 2 name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION } columns { id: 3 name: "non_null_with_default" type: UINT32 is_key: false is_nullable: false read_default_value: "90\000\000" write_default_value: "90\000\000" encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION } columns { id: 4 name: "new_col" type: UINT32 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION } columns { id: 5 name: "new_string_val" type: STRING is_key: false is_nullable: true encoding: PREFIX_ENCODING compression: DEFAULT_COMPRESSION } } schema_version: 2 new_table_name: "client-testtb2"]] with Status: Not implemented: AlterSchema not supported by MemRowSet
*** Aborted at 1408173202 (unix time) try "date -d @1408173202" if you are using GNU date ***
W0816 00:13:22.934049  9336 catalog_manager.cc:1423] TS 3f7394a056704b048e83b038e7064a09: alter failed for tablet d15b9a5469bc46829b4fa398b9c757b9 (table client-testtb2 [id=9bef36d076904638a6af4e720d819835]): Not implemented: AlterSchema not supported by MemRowSet
I0816 00:13:22.934101  9336 catalog_manager.cc:1183] Scheduling retry of d15b9a5469bc46829b4fa398b9c757b9 (table client-testtb2 [id=9bef36d076904638a6af4e720d819835]) Alter Table RPC for TS=3f7394a056704b048e83b038e7064a09 with a delay of 55ms (attempt = 1)...
PC: @     0x7f49aab2d9cb kudu::FutureCallback::StatusCB()
*** SIGSEGV (@0x0) received by PID 4813 (TID 0x7f497add5700) from PID 0; stack trace: ***
    @     0x7f49a5b5d500 (unknown) at ??:0
    @     0x7f49aab2d9cb kudu::FutureCallback::StatusCB() at ??:0
    @     0x7f49aab2f403 kudu::internal::RunnableAdapter<>::Run() at ??:0
    @     0x7f49aab2f287 kudu::internal::InvokeHelper<>::MakeItSo() at ??:0
    @     0x7f49aab2ee94 kudu::internal::Invoker<>::Run() at ??:0
    @     0x7f49ad731a28 kudu::Callback<>::Run() at ??:0
    @     0x7f49a969730a kudu::log::Log::AppendThread::RunThread() at ??:0
    @     0x7f49a96aa42d boost::_mfi::mf0<>::operator()() at ??:0
    @     0x7f49a96aa0e8 boost::_bi::list1<>::operator()<>() at ??:0
    @     0x7f49a96a9d09 boost::_bi::bind_t<>::operator()() at ??:0
    @     0x7f49a96a96cd boost::detail::function::void_function_obj_invoker0<>::invoke() at ??:0
    @     0x7f49aafaa951 boost::function0<>::operator()() at ??:0
    @     0x7f49a71ca288 kudu::Thread::SuperviseThread() at ??:0
    @     0x7f49a5b55851 start_thread at ??:0
    @     0x7f49a58a294d clone at ??:0
    @                0x0 (unknown)

Example client-test failure: http://sandbox.jenkins.cloudera.com/job/kudu-gerrit/4489/BUILD_TYPE=DEBUG,label=kudu-gerrit-slaves/artifact/build/test-logs/client-test.txt.gz

Issue Links

• is related to: KUDU-382 Add coverage for and fix concurrent AlterSchema