Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-3680

Spark cubing failed with JDBC resource

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: v2.4.0, v2.4.1, v2.5.0, v2.5.1
    • Fix Version/s: v2.6.0
    • Component/s: Spark Engine
    • Labels:
      None

      Description

      I find in JdbcHiveMRInput.java , the  system save flat table with TextFile.

      However in SparkCubingByLayer.java, the system getFlatTableStorageFormat is SequenceFile .It read the flat table as SequenceFile and failed.

      I workaround with add property "kylin.source.hive.flat-table-storage-format=TEXTFILE" in cube.

      But I think maybe we could do it better.

        Attachments

          Activity

            People

            • Assignee:
              Wayne0101 Chao Long
              Reporter:
              Zhixiong Chen Zhixiong Chen
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: