[DRILL-8119] MongoDB ObjectID becomes MAP under store.mongo.bson.record.reader = false

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 1.20.0
• Fix Version/s: 1.20.0
• Assignee: Cong Luo
• Reporter: James Turton
• Created: 31/Jan/22 09:28
• Updated: 07/Jan/23 13:51
• Resolved: 01/Feb/22 14:38

Description

The following query works in Drill 1.19 but not in 1.20.

SELECT `Elements_Efforts`.`EffortTypeName` AS `EffortTypeName`,
  `Elements`.`ElementSubTypeName` AS `ElementSubTypeName`,
  `Elements`.`ElementTypeName` AS `ElementTypeName`,
  `Elements`.`PlanID` AS `PlanID`
FROM `mongo.grounds`.`Elements` `Elements`
  INNER JOIN `mongo.grounds`.`Elements_Efforts` `Elements_Efforts` ON (`Elements`.`_id` = `Elements_Efforts`.`_id`)
WHERE (`Elements`.`PlanID` = '1623263140')
GROUP BY `Elements_Efforts`.`EffortTypeName`,
  `Elements`.`ElementSubTypeName`,
  `Elements`.`ElementTypeName`,
  `Elements`.`PlanID` 

Two issues have been reported, one is a memory leak

org.apache.drill.common.exceptions.UserException: DATA_READ ERROR: Memory was leaked by query. Memory leaked: (1945600) 

and the other is a data type error

org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: UnsupportedOperationException: Map, Array, Union or repeated scalar type should not be used in group by, order by or in a comparison operator. Drill does not support compare between MAP:REQUIRED and MAP:REQUIRED. 

.  A stack trace is attached and a query profile will be attached when (and if) I receive it.

stacktrace.txt

Issue Links

• is related to: DRILL-8190 Mongo query: "Schema change not currently supported for schemas with complex types"