[SPARK-7956] Use Janino to compile SQL expression

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: SQL
• Target Version/s: 1.5.0
• Epic Link: Tungsten Phase 1
• Assignee: Davies Liu
• Reporter: Davies Liu
• Created: 29/May/15 21:25
• Updated: 10/Jun/15 18:12
• Resolved: 04/Jun/15 17:29

Description

The overhead of current implementation of codegen is to high (50ms - 500ms), which blocks us from turning it on by default.

We should try to investigate using Janino to compile the SQL expressions into JVM bytecode, which should be much faster to compile (about 10ms).

Issue Links

• is duplicated by: SPARK-7812 Speed up SQL code generation
• is related to: SPARK-6419 GenerateOrdering does not support BinaryType and complex types.
• links to: [Github] Pull Request #6479 (davies)