Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-861

1 table out of 50,000 tables is left unimported throwing exception during deserialization

Agile BoardAttach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.8-incubating
    • None
    • None
    • Atlas commit id : 59268875d256c92f748198cea999ed5057c6bf18
      Cluster setup :
      Machine 1 : Atlas, Solr
      Machine 2 : HBase, Kafka
      Machine 3 : Client
      atlas.notification.hook.numthreads=5
      ATLAS_HOOK topic created with 5 partitions

    Description

      On importing 50,000 tables using hiveserver2, 1 table is not imported (table_7770). Below is the exception stack trace :
      java.lang.NumberFormatException: For input string: ""
      at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
      at java.lang.Long.parseLong(Long.java:453)
      at java.lang.Long.parseLong(Long.java:483)
      at java.text.DigitList.getLong(DigitList.java:194)
      at java.text.DecimalFormat.parse(DecimalFormat.java:1316)
      at java.text.SimpleDateFormat.subParse(SimpleDateFormat.java:1793)
      at java.text.SimpleDateFormat.parse(SimpleDateFormat.java:1455)
      at java.text.DateFormat.parse(DateFormat.java:355)
      at org.apache.atlas.typesystem.types.DataTypes$DateType.convert(DataTypes.java:415)
      at org.apache.atlas.typesystem.types.DataTypes$DateType.convert(DataTypes.java:400)
      at org.apache.atlas.typesystem.persistence.StructInstance.set(StructInstance.java:121)
      at org.apache.atlas.typesystem.types.ClassType.convert(ClassType.java:143)
      at org.apache.atlas.services.DefaultMetadataService.getTypedReferenceableInstance(DefaultMetadataService.java:356)
      at org.apache.atlas.services.DefaultMetadataService.deserializeClassInstances(DefaultMetadataService.java:332)
      at org.apache.atlas.services.DefaultMetadataService.updateEntities(DefaultMetadataService.java:426)
      at org.apache.atlas.web.resources.EntityResource.updateEntities(EntityResource.java:167)
      at org.apache.atlas.LocalAtlasClient$2.invoke(LocalAtlasClient.java:97)
      at org.apache.atlas.LocalAtlasClient$EntityOperation.run(LocalAtlasClient.java:118)
      at org.apache.atlas.LocalAtlasClient.updateEntities(LocalAtlasClient.java:100)
      at org.apache.atlas.AtlasClient.updateEntities(AtlasClient.java:684)
      at org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.handleMessage(NotificationHookConsumer.java:225)
      at org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.run(NotificationHookConsumer.java:187)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      at java.lang.Thread.run(Thread.java:745)
      2016-06-03 05:59:28,049 ERROR - [NotificationHookConsumer thread-1:] ~ Unable to persist entity instance (EntityResource:177)
      java.lang.IllegalArgumentException: Unable to deserialize json
      at org.apache.atlas.services.DefaultMetadataService.deserializeClassInstances(DefaultMetadataService.java:340)
      at org.apache.atlas.services.DefaultMetadataService.updateEntities(DefaultMetadataService.java:426)
      at org.apache.atlas.web.resources.EntityResource.updateEntities(EntityResource.java:167)
      at org.apache.atlas.LocalAtlasClient$2.invoke(LocalAtlasClient.java:97)
      at org.apache.atlas.LocalAtlasClient$EntityOperation.run(LocalAtlasClient.java:118)
      at org.apache.atlas.LocalAtlasClient.updateEntities(LocalAtlasClient.java:100)
      at org.apache.atlas.AtlasClient.updateEntities(AtlasClient.java:684)
      at org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.handleMessage(NotificationHookConsumer.java:225)
      at org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.run(NotificationHookConsumer.java:187)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      at java.lang.Thread.run(Thread.java:745)
      Caused by: java.lang.NumberFormatException: For input string: ""

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            suma.shivaprasad Suma Shivaprasad
            sharmadhas Sharmadha S
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment