Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-3828

hive search carbondata Partition table not support

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.6.1
    • None
    • hive-integration
    • None
    • centos,hive1.2.2

    Description

      carbon create table below;
       
      carbon.sql(
                 s"""链接标题
                    | CREATE TABLE partition_table1(
                    |   id INT,
                    |   name STRING,
                    |   city STRING,
                    |   age INT
                    | )PARTITIONED BY (`date` STRING)
                    | STORED AS carbondata TBLPROPERTIES ('flat_folder'='true')
                 """.stripMargin)
       
      问题原因是carbon分区表的元数据是在/carbon/store/default/partition_table1/Metadata/[schema|hdfs://hdfs-nameservice1/user/jice/carbon/store/default/partition_table1/date=2020-05-04/Metadata/schema]目录下
      但是hive查询的时候读取的是[/carbon/store/default/partition_table1/date=2020-05-04/Metadata/schema|hdfs://hdfs-nameservice1/user/jice/carbon/store/default/partition_table1/date=2020-05-04/Metadata/schema],导致以上报错。

      Attachments

        Activity

          People

            Unassigned Unassigned
            fann fann
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: