[CARBONDATA-1454] Block pruning not working when wrong data is given in filter

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.1
• Fix Version/s: 1.3.0
• Component/s: spark-integration
• Assignee: Unassigned
• Reporter: Babulal
• Created: 06/Sep/17 09:42
• Updated: 03/Feb/18 19:34
• Resolved: 03/Feb/18 19:34

Description

Load ~13 Million records all with 2013-07-25' date
Q1
select * from test where my_date='2013-07-25' ;
This took ~.0.5 sec

Q2
select * from test where my_date='' limit 1;

This tool ~30 sec .

Q2 data will not be found in carbon so actually it should be handled in the block pruning . and no job should be fired for it.

Same need to hanlde for timestamp also.

Solution :-
This to be consider as FalseExpression and handle same.

Issue Links

• links to: GitHub Pull Request #1915