Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-19721

Druid Storage handler throws exception when query has a Cast to Date

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.1
    • Component/s: Druid integration
    • Labels:
      None

      Description

      SELECT CAST(`ssb_druid_100`.`__time` AS DATE) AS `x_time`,
      SUM(`ssb_druid_100`.`metric_c`) AS `sum_lo_revenue_ok`
      FROM `default`.`druid_test_table` `ssb_druid_100`
      GROUP BY CAST(`ssb_druid_100`.`__time` AS DATE);
      
      2018-05-26T06:54:56,570 DEBUG [HttpClient-Netty-Worker-5] client.NettyHttpClient: [POST http://localhost:8082/druid/v2/] Got chunk: 0B, last=true
      2018-05-26T06:54:56,572 ERROR [1917f624-7b94-4990-9e3a-bbfff3656365 main] CliDriver: Failed with exception java.io.IOException:org.apache.hadoop.hive.serde2.SerDeException: Unknown type: DATE
      java.io.IOException: org.apache.hadoop.hive.serde2.SerDeException: Unknown type: DATE
              at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:602)
              at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:509)
              at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:145)
              at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:2509)
              at org.apache.hadoop.hive.ql.reexec.ReExecDriver.getResults(ReExecDriver.java:229)
              at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)
              at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188)
              at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402)
              at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:335)
              at org.apache.hadoop.hive.ql.QTestUtil.executeClientInternal(QTestUtil.java:1514)
              at org.apache.hadoop.hive.ql.QTestUtil.executeClient(QTestUtil.java:1488)
              at org.apache.hadoop.hive.cli.control.CoreCliDriver.runTest(CoreCliDriver.java:177)
              at org.apache.hadoop.hive.cli.control.CliAdapter.runTest(CliAdapter.java:104)
              at org.apache.hadoop.hive.cli.TestMiniDruidLocalCliDriver.testCliDriver(TestMiniDruidLocalCliDriver.java:43)
              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
              at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:498)
              at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
              at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
              at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
              at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
              at org.apache.hadoop.hive.cli.control.CliAdapter$2$1.evaluate(CliAdapter.java:92)
              at org.junit.rules.RunRules.evaluate(RunRules.java:20)
              at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
              at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
              at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
              at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
              at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
              at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
              at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
              at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
              at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
              at org.junit.runners.Suite.runChild(Suite.java:127)
              at org.junit.runners.Suite.runChild(Suite.java:26)
              at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
              at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
              at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
              at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
              at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
              at org.apache.hadoop.hive.cli.control.CliAdapter$1$1.evaluate(CliAdapter.java:73)
              at org.junit.rules.RunRules.evaluate(RunRules.java:20)
              at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
              at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
              at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
              at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
              at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
              at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:379)
              at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:340)
              at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125)
              at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:413)
      Caused by: org.apache.hadoop.hive.serde2.SerDeException: Unknown type: DATE
              at org.apache.hadoop.hive.druid.serde.DruidSerDe.deserialize(DruidSerDe.java:469)
              at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:583)
              ... 50 more
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                bslim Slim Bouguerra
                Reporter:
                bslim Slim Bouguerra
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: