[DRILL-1593] Hash join does not support schema changes in joins on JSON files

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Cannot Reproduce
• Fix Version/s: 0.7.0
• Component/s: Execution - Data Types
• Assignee: Hanifi Gunes
• Reporter: Neeraja
• Created: 28/Oct/14 18:05
• Updated: 29/Apr/15 19:30
• Resolved: 12/Nov/14 18:24

Description

Tried the following query and it is failing with the hash join doesnt support schema changes error. The columns queries in this case do not necessarily change schemas.

SELECT  b.name, sum(r.votes.cool)
FROM dfs.`/users/nrentachintala/Downloads/yelp_dataset_challenge_academic_dataset/yelp_academic_dataset_review.json`
 r JOIN dfs.`/users/nrentachintala/Downloads/yelp_dataset_challenge_academic_dataset/yelp_academic_dataset_business.json` b
ON (r.business_id = b.business_id)
GROUP BY  b.name
ORDER BY sum(r.votes.cool) DESC
LIMIT 10;

0: jdbc:drill:zk=local> SELECT b.name, sum(r.votes.cool)
. . . . . . . . . . . > FROM dfs.`/users/nrentachintala/Downloads/yelp_dataset_challenge_academic_dataset/yelp_academic_dataset_review.json`
. . . . . . . . . . . > r JOIN dfs.`/users/nrentachintala/Downloads/yelp_dataset_challenge_academic_dataset/yelp_academic_dataset_business.json` b
. . . . . . . . . . . > ON (r.business_id = b.business_id)
. . . . . . . . . . . > GROUP BY b.name
. . . . . . . . . . . > ORDER BY sum(r.votes.cool) DESC
. . . . . . . . . . . > LIMIT 10;
Query failed: Failure while running fragment. Hash join does not support schema changes [0114f4fe-8051-4a4b-999e-3f60828c9cff]

Error: exception while executing query: Failure while trying to get next result batch. (state=,code=0)

Adding the explain plan.

0: jdbc:drill:zk=local> explain plan for SELECT b.name, sum(r.votes.cool)
. . . . . . . . . . . > FROM dfs.`/users/nrentachintala/Downloads/yelp_dataset_challenge_academic_dataset/yelp_academic_dataset_review.json`
. . . . . . . . . . . > r JOIN dfs.`/users/nrentachintala/Downloads/yelp_dataset_challenge_academic_dataset/yelp_academic_dataset_business.json` b
. . . . . . . . . . . > ON (r.business_id = b.business_id)
. . . . . . . . . . . > GROUP BY b.name
. . . . . . . . . . . > ORDER BY sum(r.votes.cool) DESC
. . . . . . . . . . . > LIMIT 10
. . . . . . . . . . . > ;
----------------------+

text

json

----------------------+

00-00 Screen 00-01 Project(name=[$0], EXPR$1=[$1]) 00-02 SelectionVectorRemover 00-03 Limit(fetch=[10]) 00-04 SelectionVectorRemover 00-05

----------------------+