Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-1887

block pruning not happening is carbon for ShortType and SmallIntType columns

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.3.0
    • None
    • None

    Description

      spark.sql(
      s"""

      create table test_numeric_type(c1 int, c2 long, c3 smallint, c4 bigint, c5 short) stored by 'carbondata'
      """.stripMargin).show()
      spark.sql(
      s"""
      insert into test_numeric_type select 1,1111111,111,1111111111,'2019-01-03 12:12:12'
      """.stripMargin).show()

      spark.sql(
      s"""

      insert into test_numeric_type select 2,2222222,222,2222222222,'2020-01-03 12:12:12'
      """.stripMargin).show()

      spark.sql(
      s"""

      insert into test_numeric_type select 3,3333333,333,3333333333,'2021-01-03 12:12:12'
      """.stripMargin).show()

      spark.sql(
      s"""

      select * from test_numeric_type where c5>1111
      """.stripMargin).show()

      Only two blocks should be selected but all blocks are selected during query execution.

      Attachments

        Activity

          People

            mohdshahidkhan Mohammad Shahid Khan
            mohdshahidkhan Mohammad Shahid Khan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 4h 20m
                4h 20m