[CARBONDATA-4283] IUD Performance degrade for Carbon with Spark 3.1.1 over Carbon with Spark 2.4.5

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.2.0, 2.3.0
• Component/s: data-query
• Environment: Contents verified on Spark 2.4.5 and Spark 3.1.1.
• Assignee: Unassigned
• Reporter: PRIYESH RANJAN
• Created: 14/Sep/21 08:20
• Updated: 27/Sep/21 10:55
• Resolved: 27/Sep/21 10:55

Description

IUD Performance degrade for Carbon with Spark 3.1.1 over Carbon with Spark 2.4.5 using 5million record in table is as follows :  

             Update Performance --> Update Performance on Table has degraded by 18.58% for Carbon with Spark 3.1.1 over Carbon with Spark 2.4.5

                                                  --> Query Performance  taken on an average of 3 queries  after respective percentage update operations on Table has degraded by  15.97% for Carbon with Spark 3.1.1 over Carbon with Spark 2.4.5

             Delete Performance> Delete Performance on Table has degraded  by 7.99% for Carbon with Spark 3.1.1 over Carbon with Spark 2.4.5.