[ATLAS-861] 1 table out of 50,000 tables is left unimported throwing exception during deserialization

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8-incubating
• Fix Version/s: 0.8-incubating, 0.7.1-incubating
• Environment: Atlas commit id : 59268875d256c92f748198cea999ed5057c6bf18; Cluster setup :; Machine 1 : Atlas, Solr; Machine 2 : HBase, Kafka; Machine 3 : Client; atlas.notification.hook.numthreads=5; ATLAS_HOOK topic created with 5 partitions
• Assignee: Suma Shivaprasad
• Reporter: Sharmadha S
• Created: 06/Jun/16 06:48
• Updated: 04/Jan/17 08:22
• Resolved: 01/Aug/16 04:05

Description

On importing 50,000 tables using hiveserver2, 1 table is not imported (table_7770). Below is the exception stack trace :
java.lang.NumberFormatException: For input string: ""
at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Long.parseLong(Long.java:453)
at java.lang.Long.parseLong(Long.java:483)
at java.text.DigitList.getLong(DigitList.java:194)
at java.text.DecimalFormat.parse(DecimalFormat.java:1316)
at java.text.SimpleDateFormat.subParse(SimpleDateFormat.java:1793)
at java.text.SimpleDateFormat.parse(SimpleDateFormat.java:1455)
at java.text.DateFormat.parse(DateFormat.java:355)
at org.apache.atlas.typesystem.types.DataTypes$DateType.convert(DataTypes.java:415)
at org.apache.atlas.typesystem.types.DataTypes$DateType.convert(DataTypes.java:400)
at org.apache.atlas.typesystem.persistence.StructInstance.set(StructInstance.java:121)
at org.apache.atlas.typesystem.types.ClassType.convert(ClassType.java:143)
at org.apache.atlas.services.DefaultMetadataService.getTypedReferenceableInstance(DefaultMetadataService.java:356)
at org.apache.atlas.services.DefaultMetadataService.deserializeClassInstances(DefaultMetadataService.java:332)
at org.apache.atlas.services.DefaultMetadataService.updateEntities(DefaultMetadataService.java:426)
at org.apache.atlas.web.resources.EntityResource.updateEntities(EntityResource.java:167)
at org.apache.atlas.LocalAtlasClient$2.invoke(LocalAtlasClient.java:97)
at org.apache.atlas.LocalAtlasClient$EntityOperation.run(LocalAtlasClient.java:118)
at org.apache.atlas.LocalAtlasClient.updateEntities(LocalAtlasClient.java:100)
at org.apache.atlas.AtlasClient.updateEntities(AtlasClient.java:684)
at org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.handleMessage(NotificationHookConsumer.java:225)
at org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.run(NotificationHookConsumer.java:187)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-06-03 05:59:28,049 ERROR - [NotificationHookConsumer thread-1:] ~ Unable to persist entity instance (EntityResource:177)
java.lang.IllegalArgumentException: Unable to deserialize json
at org.apache.atlas.services.DefaultMetadataService.deserializeClassInstances(DefaultMetadataService.java:340)
at org.apache.atlas.services.DefaultMetadataService.updateEntities(DefaultMetadataService.java:426)
at org.apache.atlas.web.resources.EntityResource.updateEntities(EntityResource.java:167)
at org.apache.atlas.LocalAtlasClient$2.invoke(LocalAtlasClient.java:97)
at org.apache.atlas.LocalAtlasClient$EntityOperation.run(LocalAtlasClient.java:118)
at org.apache.atlas.LocalAtlasClient.updateEntities(LocalAtlasClient.java:100)
at org.apache.atlas.AtlasClient.updateEntities(AtlasClient.java:684)
at org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.handleMessage(NotificationHookConsumer.java:225)
at org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.run(NotificationHookConsumer.java:187)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NumberFormatException: For input string: ""