[CARBONDATA-2435] SDK dependency Spark jar

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.0
• Assignee: Bo Xu
• Reporter: Bo Xu
• Created: 04/May/18 03:09
• Updated: 10/May/18 10:54
• Resolved: 10/May/18 10:54

Description

SDK dependency Spark jar, we should remove it.

java.lang.ClassNotFoundException: org.apache.spark.util.SizeEstimator
	at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1291)
	at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1119)
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:264)
	at org.apache.carbondata.core.util.ObjectSizeCalculator.estimate(ObjectSizeCalculator.java:56)
	at org.apache.carbondata.core.cache.dictionary.ReverseDictionaryCache.<clinit>(ReverseDictionaryCache.java:53)
	at org.apache.carbondata.core.cache.CacheProvider.createDictionaryCacheForGivenType(CacheProvider.java:115)
	at org.apache.carbondata.core.cache.CacheProvider.createCache(CacheProvider.java:100)
	at org.apache.carbondata.processing.loading.converter.impl.RowConverterImpl.initialize(RowConverterImpl.java:89)
	at org.apache.carbondata.processing.loading.steps.DataConverterProcessorStepImpl.initialize(DataConverterProcessorStepImpl.java:81)
	at org.apache.carbondata.processing.loading.steps.SortProcessorStepImpl.initialize(SortProcessorStepImpl.java:53)
	at org.apache.carbondata.processing.loading.steps.DataWriterProcessorStepImpl.initialize(DataWriterProcessorStepImpl.java:75)
	at org.apache.carbondata.processing.loading.DataLoadExecutor.execute(DataLoadExecutor.java:48)
	at org.apache.carbondata.hadoop.api.CarbonTableOutputFormat$1.run(CarbonTableOutputFormat.java:251)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

Issue Links

• links to: GitHub Pull Request #2289