Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-4205

configuration support set hive.intermediate-table-prefix

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: v3.0.0-alpha
    • Fix Version/s: None
    • Component/s: Job Engine
    • Labels:
      None

      Description

      There are thousands of cubes in didi, so in order to cut the metadata we have 4 kylin clusters. They use 1 hdfs cluster, 1 hive database, and 1 hbase cluster.

      KYLIN_INTERMEDIATE_PREFIX is set by MetadataConstants. In order to the unused intermediate table can be properly cleaned up by cleanTool, the intermediate table prefix needs to be set differently by kylin config.
      kylin config add kylin.source.hive.intermediate-table-prefix´╝î default 'kylin_intermediate_'.

        Attachments

        1. KYLIN-4205.master.002.patch
          17 kB
          chuxiao
        2. KYLIN-4205.master.001.patch
          17 kB
          chuxiao

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              xiaoge chuxiao
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: