Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-2488

query failed because scan threshold

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Not A Problem
    • v1.6.0
    • None
    • Query Engine
    • None

    Description

      When i submit this query:
      select "time_by_day_alias"."THE_YEAR" as "c0", "git_log_alias"."PROJECT_NAME" as "c1", "git_log_alias"."BRANCH_NAME" as "c2", count(distinct "git_log_alias"."COMMIT_ID") as "m0" from "CODE_VIEW_178E383E_623C_45E3_BA1B_1333DFE2240B" as "git_log_alias" join "TIME_BY_DAY" as "time_by_day_alias" on "git_log_alias"."FORMATED_DATE" = "time_by_day_alias"."THE_DATE" group by "time_by_day_alias"."THE_YEAR", "git_log_alias"."PROJECT_NAME", "git_log_alias"."BRANCH_NAME"

      I got following error even though i set kylin.query.scan.threshold=100000000

      2017-03-07 14:27:43,770 INFO [Query c422b09c-b1a5-4dcc-afac-7c9a25cff3fe-66] endpoint.CubeVisitService: The cube visit did not finish normally because scan num exceeds threshold
      org.apache.kylin.gridtable.GTScanExceedThresholdException: Exceed scan threshold at 49145
      at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService$1.hasNext(CubeVisitService.java:258)
      at org.apache.kylin.storage.hbase.cube.v2.HBaseReadonlyStore$1$1.hasNext(HBaseReadonlyStore.java:111)
      at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:290)
      at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:4117)
      at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7864)
      at org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1991)
      at org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1973)
      at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33652)
      at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2180)
      at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
      at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
      at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
      at java.lang.Thread.run(Thread.java:745)

      Attachments

        1. cube.PNG
          24 kB
          zhou degao

        Activity

          People

            liyang.gmt8@gmail.com liyang
            zhoudegao zhou degao
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: