[TINKERPOP-1295] Precompile ScriptInputFormat scripts once during initialization of ScriptRecordReader

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0-incubating, 3.1.2-incubating
• Fix Version/s: 3.1.3, 3.2.1
• Component/s: hadoop, io
• Assignee: Ted Wilmes
• Reporter: Ted Wilmes
• Created: 06/May/16 13:25
• Updated: 11/May/16 04:05
• Resolved: 11/May/16 04:05

Description

The ScriptRecordReader evals scripts on every nextKeyValue(). I think we can cut down on script execution evaluation time by precompiling the input script once. This should speedup bulk loads. I've attached some profiling info showing a large chunk of time being spent on this eval during a recent test run.