Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-1758

createLookupHiveViewMaterializationStep will create intermediate table for fact table

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • v1.5.2
    • v1.5.2.1
    • Job Engine
    • None
    • hadoop2.4, hbase1.1.2

    Description

      In our model, the fact table is a hive view. When i build cube(I selected one partition for one day's data), the job was trying to create intermediate table by sql :
      DROP TABLE IF EXISTS kylin_intermediate_OLAP_OLAP_FLW_PCM_MAU;
      CREATE TABLE IF NOT EXISTS kylin_intermediate_OLAP_OLAP_FLW_PCM_MAU
      LOCATION '/team/db/kylin15/kylin_metadata15/kylin-65c7ee9a-3024-4633-927c-19e992ed155a/kylin_intermediate_OLAP_OLAP_FLW_PCM_MAU'
      AS SELECT * FROM OLAP.OLAP_FLW_PCM_MAU;

      1. There is no partition string in where string (I selected only one partition), which cause a very very big MR.

      2. Note that, our lookup table is not a view.

      Attachments

        Issue Links

          Activity

            People

              shaofengshi Shao Feng Shi
              dixingxing@yeah.net Xingxing Di
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: