[LENS-409] Fix usage of new HiveConf() and Hive.get() in ml lib

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: ml
• Assignee: Jaideep Dhok
• Reporter: Amareshwari Sriramadasu
• Created: 16/Mar/15 04:36
• Updated: 27/Jun/16 08:48

Description

We saw new HiveConf() call is costlier : See LENS-408. The following occurrences in ml-lib needs to be looked into to see if they are required.

lens-ml-lib amareshwari.sr$ git grep 'new HiveConf(' src/main/java/
src/main/java/org/apache/lens/ml/MLUtils.java:    HIVE_CONF = new HiveConf();
src/main/java/org/apache/lens/ml/ModelLoader.java:          FileSystem fs = modelPath.getFileSystem(new HiveConf());
src/main/java/org/apache/lens/ml/spark/algos/BaseSparkAlgo.java:    HiveConf hiveConf = new HiveConf();
src/main/java/org/apache/lens/ml/spark/algos/KMeansAlgo.java:    HiveConf hiveConf = new HiveConf();
src/main/java/org/apache/lens/rdd/LensRDDClient.java:  protected static final HiveConf HIVE_CONF = new HiveConf();
src/main/java/org/apache/lens/server/ml/MLServiceResource.java:    HIVE_CONF = new HiveConf();