Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-26497 Support materialized views on Iceberg source tables
  3. HIVE-26498

Implement MV maintenance with Iceberg sources using full rebuild

    XMLWordPrintableJSON

Details

    Description

      set hive.support.concurrency=true;
      set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
      
      create external table tbl_ice(a int, b string, c int) stored by iceberg stored as orc tblproperties ('format-version'='2');
      
      insert into tbl_ice values (1, 'one', 50), (2, 'two', 51), (3, 'three', 52), (4, 'four', 53), (5, 'five', 54);
      
      create materialized view mat1 as
      select b, c from tbl_ice where c > 52;
      
      insert into tbl_ice values (111, 'one', 55), (333, 'two', 56);
      
      explain cbo
      alter materialized view mat1 rebuild;
      
      alter materialized view mat1 rebuild;
      

      MV full rebuild plan

      CBO PLAN:
      HiveProject(b=[$1], c=[$2])
        HiveFilter(condition=[>($2, 52)])
          HiveTableScan(table=[[default, tbl_ice]], table:alias=[tbl_ice])
      

      Attachments

        Issue Links

          Activity

            People

              kkasa Krisztian Kasa
              kkasa Krisztian Kasa
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 6.5h
                  6.5h