[CARBONDATA-3072] Show segment data size and index size does not display correctly for table created in older version upgraded to latest version

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.5.0, 1.5.1
• Component/s: data-query
• Environment: Spark 2.1
• Assignee: Jacky Li
• Reporter: Chetan Bhat
• Due: 30/Nov/18
• Created: 05/Nov/18 06:12
• Updated: 05/Nov/18 14:26

Description

Steps :

Create table in version older than 1.5.0 and load data to table.

Create a database in 1.5.0 or 1.5.1.

Copy the older version store to HDFS path of 1.5.0 or 1.5.1.

Refresh the table using the refresh table command.

Execute show segment command for the table.

 

Issue : Show segment data size and index size displays incorrectly as 0.0B and 0.0B.

0: jdbc:hive2://10.18.98.225:22550/default> show segments for table brinjal;
---------------------------------------------------------------------------------------------------------------------------------

SegmentSequenceId

Status

Load Start Time

Load End Time

Merged To

File Format

Data Size

Index Size

---------------------------------------------------------------------------------------------------------------------------------

3	Marked for Delete	2017-12-27 19:27:43.471	2017-12-27 19:27:50.737	NA	COLUMNAR_V3	0.0B	0.0B
2	Success	2017-12-26 20:18:22.775	2017-12-26 20:18:23.793	NA	COLUMNAR_V3	0.0B	0.0B
1	Success	2017-12-26 20:18:19.822	2017-12-26 20:18:20.371	NA	COLUMNAR_V3	0.0B	0.0B
0	Success	2017-12-26 20:18:09.392	2017-12-26 20:18:16.024	NA	COLUMNAR_V3	0.0B	0.0B

---------------------------------------------------------------------------------------------------------------------------------
4 rows selected (0.56 seconds)

 

Expected : Show segment data size and index size should display correct size as shown below.

0: jdbc:hive2://10.18.98.225:22550/default> show segments for table brinjal;
-----------------------------------------------------------------------------------------------------------------------

SegmentSequenceId

Status

Load Start Time

Load End Time

Merged To

File Format

Data Size

Index Size

-----------------------------------------------------------------------------------------------------------------------

1	Success	2018-11-02 22:31:34.103	2018-11-02 22:31:34.77	NA	COLUMNAR_V3	6.52KB	1.63KB
0	Success	2018-11-02 22:31:20.54	2018-11-02 22:31:21.273	NA	COLUMNAR_V3	6.52KB	1.63KB

-----------------------------------------------------------------------------------------------------------------------

Issue Links

• is related to: CARBONDATA-2906 Show segment data size in SHOW SEGMENT command