[DRILL-5278] CTTAS store.format=csv, returns one extra record

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Not A Bug
• Affects Version/s: 1.10.0
• Component/s: Storage - Text & CSV
• Assignee: Unassigned
• Reporter: Khurram Faraaz
• Created: 20/Feb/17 18:02
• Updated: 08/Mar/17 09:25
• Resolved: 08/Mar/17 09:25

Description

When store.format = csv, we see incorrect results returned, an extra record is returned, as compared to when store.format = parquet. The difference is seen when doing a count over a temporary table created in Drill.

Drill 1.10.0 git commit ID : 300e9349

Steps to reproduce the problem.

0: jdbc:drill:schema=dfs.tmp> reset all;
+-------+---------------+
|  ok   |    summary    |
+-------+---------------+
| true  | ALL updated.  |
+-------+---------------+
1 row selected (0.279 seconds)
0: jdbc:drill:schema=dfs.tmp> ALTER SESSION SET `store.format`='csv';
+-------+------------------------+
|  ok   |        summary         |
+-------+------------------------+
| true  | store.format updated.  |
+-------+------------------------+
1 row selected (0.21 seconds)
0: jdbc:drill:schema=dfs.tmp> CREATE TEMPORARY TABLE dfs.tmp.temp_tbl
. . . . . . . . . . . . . . > AS
. . . . . . . . . . . . . . > SELECT * FROM typeall_l;
+-----------+----------------------------+
| Fragment  | Number of records written  |
+-----------+----------------------------+
| 0_0       | 105                        |
+-----------+----------------------------+
1 row selected (0.233 seconds)
0: jdbc:drill:schema=dfs.tmp> SELECT COUNT(*) FROM dfs.tmp.temp_tbl;
+---------+
| EXPR$0  |
+---------+
| 106     |
+---------+
1 row selected (0.189 seconds)
0: jdbc:drill:schema=dfs.tmp> drop table dfs.tmp.temp_tbl;
+-------+-------------------------------------+
|  ok   |               summary               |
+-------+-------------------------------------+
| true  | Temporary table [temp_tbl] dropped  |
+-------+-------------------------------------+
1 row selected (0.186 seconds)
0: jdbc:drill:schema=dfs.tmp> ALTER SESSION SET `store.format`='parquet';
+-------+------------------------+
|  ok   |        summary         |
+-------+------------------------+
| true  | store.format updated.  |
+-------+------------------------+
1 row selected (0.196 seconds)
0: jdbc:drill:schema=dfs.tmp> CREATE TEMPORARY TABLE dfs.tmp.temp_tbl
. . . . . . . . . . . . . . > AS
. . . . . . . . . . . . . . > SELECT * FROM typeall_l;
+-----------+----------------------------+
| Fragment  | Number of records written  |
+-----------+----------------------------+
| 0_0       | 105                        |
+-----------+----------------------------+
1 row selected (0.263 seconds)
0: jdbc:drill:schema=dfs.tmp> SELECT COUNT(*) FROM dfs.tmp.temp_tbl;
+---------+
| EXPR$0  |
+---------+
| 105     |
+---------+
1 row selected (0.169 seconds)
0: jdbc:drill:schema=dfs.tmp> drop table dfs.tmp.temp_tbl;
+-------+-------------------------------------+
|  ok   |               summary               |
+-------+-------------------------------------+
| true  | Temporary table [temp_tbl] dropped  |
+-------+-------------------------------------+
1 row selected (0.165 seconds)
0: jdbc:drill:schema=dfs.tmp>