[DERBY-4348] Copy table content with "INSERT INTO table SELECT FROM (...)" statement leads to corrupt data

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 10.0.2.1, 10.1.1.0, 10.2.1.6, 10.2.2.0, 10.3.1.4, 10.4.2.0, 10.5.1.1, 10.6.1.0
• Fix Version/s: 10.5.3.1, 10.6.1.0
• Component/s: SQL
• Environment: Derby: embedded driver 10.5.1.1 - (764942); testet with 10.4 and client driver also; OS: Windows XP; SQL statements executed using SQuirrel SQL Client, but behavior is the same with ij
• Urgency: Urgent
• Issue & fix info: Repro attached
• Bug behavior facts: Data corruption
• Assignee: Knut Anders Hatlen
• Reporter: Stefan Huber
• Created: 12/Aug/09 11:21
• Updated: 21/Jan/11 17:52
• Resolved: 31/Aug/09 07:47

Description

I had to change a the primary key of a table and used ddlutils to do so. Ddlutils recreated the table to perform this task.
After the schema conversion the row data of the changed table were corrupted.
The values of the last table column were filled with values from other rows!

After performing a few tests I could break down the problem to the SQL statement "INSERT INTO table SELECT FROM (...)"

To reprocude the effect do the following:

1. unpack attached database 'rmdb.zip'

2. connect to the database with embedded driver
User: IGEL
Password: test

3. read data of an example row from database
select * from stringrangenew where classname = 'x.xserver%.colordepth';

result is
x.xserver%.colordepth 2 [16] [24] [32]

4. now copy the data to the second table (column INSTANCENR has been added to this table)
INSERT INTO STRINGRANGENEW_ (CLASSNAME,FIRMWAREID,RVALUE) SELECT CLASSNAME,FIRMWAREID,RVALUE FROM STRINGRANGENEW;

5. select data of example row from second table
select * from stringrangenew_ where classname = 'x.xserver%.colordepth';

result is
x.xserver%.colordepth 2 -1 [CCW][CW][XX]

-> value of last column is not the same as in orignal table!

Here some additional information i worked out during my tests:

• if you change the copy statement to include the additional column INSTANCENR, the copied data are correct.
  delete from STRINGRANGENEW_;
  INSERT INTO STRINGRANGENEW_ (CLASSNAME,FIRMWAREID, INSTANCENR, RVALUE) SELECT CLASSNAME,FIRMWAREID, -1, RVALUE FROM STRINGRANGENEW;

• if you select the rows only 'SELECT CLASSNAME,FIRMWAREID,RVALUE FROM STRINGRANGENEW', the result shows correct data

Note:
The effect is not restricted to this row but also applies to other rows. But it's always the same rows, that get corrupted.