Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-2666

Query against json profile with large number of fragments fails

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Not A Problem
    • 0.8.0
    • 0.9.0
    • Execution - Flow
    • None

    Description

      git.commit.id=417ad38f7239c6dc1ff0421cbd5a2358d1437c87

      I have a json profile that contains about 300 fragments. When I try to run queries against it, the query would fail with "You tried to do a batch data read operation when you were in a state of STOP" error. Below is an example:

      0: jdbc:drill:schema=dfs.hbase> select t3.majorId from (select t2.majorFragmentId majorId,t2.minorFragmentProfile.minorFragmentId minorId,flatten(t2.minorFragmentProfile.operatorProfile) oProfile from (select t1.col.majorFragmentId majorFragmentId,flatten(t1.col.minorFragmentProfile) minorFragmentProfile from (select flatten(t.fragmentprofile) col from `dfs.drillTestDir`.`/ui_profiles/cancelled_query2.json`t) t1) t2) t3 group by t3.majorId,t3.oProfile.operatorId,t3.oProfile.operatorType order by t3.majorId,t3.oProfile.operatorId;
      Query failed: RemoteRpcException: Failure while running fragment., You tried to do a batch data read operation when you were in a state of STOP.  You can only do this type of operation when you are in a state of OK or OK_NEW_SCHEMA. [ 4de479a5-ce93-4a3f-89b4-3aa55481869c on qa-node114.qa.lab:31010 ]
      [ 4de479a5-ce93-4a3f-89b4-3aa55481869c on qa-node114.qa.lab:31010 ]
      

      For json profile files that contain smaller number of fragments, the queries run fine.

      Attachments

        1. cancelled_query2.json.gz
          64 kB
          Krystal
        2. drill2666.log
          48 kB
          Krystal
        3. small_cancelled_query2.json
          7 kB
          Sudheesh Katkam

        Issue Links

          Activity

            People

              sudheeshkatkam Sudheesh Katkam
              knguyen Krystal
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: