[CARBONDATA-2261] Support Set segment command for Streaming Table

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.3.0
• Fix Version/s: 1.4.0, 1.3.1
• Component/s: data-query, file-format
• Assignee: Babulal
• Reporter: Babulal
• Created: 18/Mar/18 16:32
• Updated: 21/Mar/18 15:19
• Resolved: 21/Mar/18 15:19

Description

Currently Set Segment  is not supported for Streaming Segments . 

Detail

 

-----------------------------------------------------------------------------------------+

SegmentSequenceId

Status

Load Start Time

Load End Time

Merged To

File Format

-----------------------------------------------------------------------------------------+

2	Success	2018-03-18 00:32:16.783	2018-03-18 00:32:17.036	NA	COLUMNAR_V3
1	Streaming Finish	2018-03-18 00:31:59.797	2018-03-18 00:32:24.016	NA	ROW_V1
0	Compacted	2018-03-18 00:31:53.125	2018-03-18 00:31:59.797	2	ROW_V1

-----------------------------------------------------------------------------------------+

 

Currently  "Streaming Finished" Or "Streaming "  status segments are not filtered  even these segments are not mentioned in the set segment command . 

fif user run below query

sql("set carbon.input.segments.streaming.stream_table_handoff = 2") 

it should give data based on segment 2 but query includes segment 1 also . 

 

 

Issue Links

• links to: GitHub Pull Request #2075