[CARBONDATA-2515] Filter OR Expression not working properly in Presto integration

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 1.5.0, 1.4.1
• Component/s: presto-integration
• Environment: Spark 2.1, Presto 0.187
• Assignee: Sourabh Verma
• Reporter: Sourabh Verma
• Created: 22/May/18 11:17
• Updated: 26/Jun/18 08:56
• Resolved: 26/Jun/18 08:56

Description

Scenario - carbon-data Table 'load_table' with columns 'integer', 'datetime'

//table creation and load code (spark)
val random = new Random()
val df = spark.sparkContext.parallelize(1 to (365 * 24 * 360))
.map(x => (random.nextInt(200), new Timestamp(currentMillis - (x * 1000l))))
.toDF("integer", "datetime")

// Saves dataframe to carbondata file
df.write.format("carbondata")
.option("tableName", "load_table")
.option("compress", "true")
.option("tempCSV", "false")
.mode(SaveMode.Overwrite)
.save()

SQL (through Presto CLI) - select * from load_table where integer < 10 or integer > 50;

Actual result - 0 rows.
Expected result - rows with integer value less than 10 and greater than 50.

cause - PrestoFilterUtil is creating AND Expressions.

Issue Links

• links to: GitHub Pull Request #2334