Apache Drill
  1. Apache Drill
  2. DRILL-487

Joining across different data sources throw 'schema change' exception

    Details

      Description

      Cross data source queries are throwing exception. Examples include between a file and Hive table, a hive table and HBase table, 2 files of different formats.

      Here is a simple example. I will add more detailed log.

      select c.c_custkey from
      dfs.`/home/mapr/tpch/sf-0.1_tpc-h_DataParquet/customer.parquet` c,
      dfs.`/home/mapr/sample-data/userprofilejson/user1.json` u
      where c.c_custkey = u.id;

      user1.json is below.
      {
      "id":8362,
      "account":

      { "name":"Alice", "email":"Alice@gmail.com" }

      ,
      "address":

      { "street":"123 Ballmer Av", "zipcode":"12345", "state":"CA" }

      }

      Exception:
      message: "Screen received stop request sent. < SchemaChangeException:[ org.apache.drill.exec.exception.ClassTransformationException: Failure generating transformation classes for value: \n \npackage org.apache.drill.exec.test.generated;\n\nimport org.apache.drill.exec.exception.SchemaChangeException;\nimport org.apache.drill.exec.ops.FragmentContext;\nimport org.apache.drill.exec.physical.impl.join.JoinStatus;\nimport org.apache.drill.exec.record.RecordBatch;\nimport org.apache.drill.exec.record.VectorContainer;\nimport org.apache.drill.exec.vector.BigIntVector;\nimport org.apache.drill.exec.vector.Float8Vector;\nimport org.apache.drill.exec.vector.NullableBigIntVector;\nimport org.apache.drill.exec.vector.NullableIntVector;\nimport org.apache.drill.exec.vector.NullableVarCharVector;\nimport org.apache.drill.exec.vector.VarBinaryVector;\n\npublic class JoinWorkerGen141 {\n\n JoinStatus status;\n VectorContainer outgoing;\n

        Activity

        Parth Chandra made changes -
        Component/s Execution - Relational Operators [ 12322705 ]
        Tony Stevenson made changes -
        Workflow no-reopen-closed, patch-avail, testing [ 12859972 ] Drill workflow [ 12934215 ]
        Jacques Nadeau made changes -
        Fix Version/s 0.4.0 [ 12324963 ]
        Jake Farrell made changes -
        Workflow no-reopen-closed, patch-avail [ 12854105 ] no-reopen-closed, patch-avail, testing [ 12859972 ]
        Jacques Nadeau made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Aman Sinha made changes -
        Aman Sinha made changes -
        Field Original Value New Value
        Assignee Aman Sinha [ amansinha100 ]
        Neeraja created issue -

          People

          • Assignee:
            Aman Sinha
            Reporter:
            Neeraja
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development