0. IMPORTANT ISSUES: Section 1. CLASSES AND OBJECTS (threshold: 10%) High memory usage by String: 140,237K (28.8%) High memory usage by j.u.Properties: 94,616K (19.4%) High memory usage by j.u.HashMap: 53,749K (11.0%) Section 3. OBJECT HEADERS (threshold: 5%) High memory usage by object headers of j.u.Hashtable$Entry: 25,781K (5.3%) Section 6. DUPLICATE STRINGS (threshold: 5%) High overhead of all duplicate strings: 119,349K (24.5%) Section 8. BAD COLLECTIONS (threshold: 2%) High overhead of all bad collections: 89,439K (18.3%) High overhead of type 1-elem j.u.ArrayList: 21,027K (4.3%) High overhead of type 1-elem j.u.LinkedHashMap: 15,191K (3.1%) High overhead of type small j.u.HashMap: 14,710K (3.0%) High overhead of type empty java.util.concurrent.ConcurrentHashMap: 14,628K (3.0%) =================================================== Generated by JXRay version 1.3 Heap dump hs2-crash-2000p-500m-50q.hprof created on Thu Jan 12 22:18:31 PST 2017 JVM pointer size: 4 bytes, object header size: 12 bytes Total num of objects: 11,300,261 Instances: 9,128,857, object arrays: 1,047,939, primitive arrays: 1,123,465 Total size of all objects: 487,426K (100.0%) Instances: 275,839K (56.6%), object arrays: 85,011K (17.4%), primitive arrays: 126,575K (26.0%) Live objects: 10,988,221, garbage objects: 312,040 Live bytes: 474,234K (97.3%), garbage bytes: 13,191K (2.7%) Total num of classes: 9,165 =================================================== 1. CLASSES AND OBJECTS #instances Shallow size Impl-inclusive size Class name --------------------------------------------------------------- 1,093,250 25,623K (5.3%) 140,237K (28.8%) String 89,014 4,172K (0.9%) 94,616K (19.4%) j.u.Properties 362,055 16,971K (3.5%) 53,749K (11.0%) j.u.HashMap 719,609 16,865K (3.5%) 41,875K (8.6%) j.u.ArrayList 1,427,776 33,463K (6.9%) 33,463K (6.9%) org.apache.hadoop.hive.metastore.api.FieldSchema 177,427 9,703K (2.0%) 23,658K (4.9%) j.u.LinkedHashMap 2,143 133K (0.0%) 14,630K (3.0%) java.util.concurrent.ConcurrentHashMap 88,248 1,378K (0.3%) 10,363K (2.1%) j.u.LinkedHashSet 89,231 5,576K (1.1%) 5,576K (1.1%) org.apache.hadoop.hive.metastore.api.StorageDescriptor 1,101,947 120,113K (24.6%) 5,499K (1.1%) char[] 62,854 4,910K (1.0%) 4,910K (1.0%) java.net.URI 89,186 4,877K (1.0%) 4,877K (1.0%) org.apache.hadoop.hive.metastore.api.Partition 88,045 4,814K (1.0%) 4,814K (1.0%) org.apache.hadoop.hive.ql.hooks.ReadEntity 7,199 3,497K (0.7%) 3,497K (0.7%) byte[] 88,088 3,440K (0.7%) 3,440K (0.7%) org.apache.hadoop.hive.ql.plan.PartitionDesc 113,798 3,427K (0.7%) 3,427K (0.7%) String[] 90,045 2,813K (0.6%) 2,813K (0.6%) org.apache.hadoop.hive.ql.lockmgr.HiveLockObject$HiveLockObjectData 176,491 2,757K (0.6%) 2,757K (0.6%) j.u.HashMap$EntrySet 88,000 2,750K (0.6%) 2,750K (0.6%) org.apache.hadoop.hive.ql.metadata.Partition 90,090 2,111K (0.4%) 2,111K (0.4%) org.apache.hadoop.hive.ql.lockmgr.HiveLockObject 89,233 2,091K (0.4%) 2,091K (0.4%) org.apache.hadoop.hive.metastore.api.StorageDescriptor$_Fields[] 89,230 2,091K (0.4%) 2,091K (0.4%) org.apache.hadoop.hive.metastore.api.SkewedInfo 89,230 2,091K (0.4%) 2,091K (0.4%) org.apache.hadoop.hive.metastore.api.SerDeInfo 89,188 2,090K (0.4%) 2,090K (0.4%) org.apache.hadoop.hive.metastore.api.Partition$_Fields[] 367,487 26,744K (5.5%) 1,665K (0.3%) Object[] 64,064 1,501K (0.3%) 1,501K (0.3%) org.apache.hadoop.hive.ql.lockmgr.HiveLockObj 4,673 1,444K (0.3%) 1,444K (0.3%) int[] 7,791 1,404K (0.3%) 1,404K (0.3%) short[] 55,605 1,303K (0.3%) 1,303K (0.3%) org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLock 62,710 979K (0.2%) 979K (0.2%) org.apache.hadoop.fs.Path 1,030 16K (0.0%) 773K (0.2%) j.u.HashSet 418 13K (0.0%) 720K (0.1%) j.u.LinkedList 7,750 666K (0.1%) 666K (0.1%) java.lang.reflect.Method 17 0K (0.0%) 503K (0.1%) java.util.concurrent.ConcurrentSkipListMap =================================================== 2. LIVE VS GARBAGE OBJECTS Live objects: 10,988,221, garbage objects: 312,040, total objects: 11,300,261 Live bytes: 474,234K (97.3%), garbage bytes: 13,191K (2.7%), total bytes: 487,426K (100.0%) #instances Shallow size #instances Shallow size Class name garbage garbage live live ---------------------------------------------------------------------------- 73,538 5,521K (1.1%) 1,028,409 114,592K (23.5%) char[] 3 0K (0.0%) 2,199,983 68,749K (14.1%) j.u.Hashtable$Entry 2 0K (0.0%) 1,427,774 33,463K (6.9%) org.apache.hadoop.hive.metastore.api.FieldSchema 4,511 771K (0.2%) 362,976 25,973K (5.3%) Object[] 65,238 1,529K (0.3%) 1,028,012 24,094K (4.9%) String 536 40K (0.0%) 269,155 23,275K (4.8%) j.u.HashMap$Node[] 725 22K (0.0%) 744,487 23,265K (4.8%) j.u.HashMap$Node 96 6K (0.0%) 90,233 21,896K (4.5%) j.u.Hashtable$Entry[] 456 21K (0.0%) 361,599 16,949K (3.5%) j.u.HashMap 713 16K (0.0%) 718,896 16,849K (3.5%) j.u.ArrayList 1,095 42K (0.0%) 354,469 13,846K (2.8%) j.u.LinkedHashMap$Entry 1,295 40K (0.0%) 329,807 10,306K (2.1%) java.util.concurrent.ConcurrentHashMap$Node 329 17K (0.0%) 177,098 9,685K (2.0%) j.u.LinkedHashMap 0 0K (0.0%) 89,231 5,576K (1.1%) org.apache.hadoop.hive.metastore.api.StorageDescriptor 62 4K (0.0%) 62,792 4,905K (1.0%) java.net.URI 0 0K (0.0%) 89,186 4,877K (1.0%) org.apache.hadoop.hive.metastore.api.Partition 0 0K (0.0%) 88,045 4,814K (1.0%) org.apache.hadoop.hive.ql.hooks.ReadEntity 0 0K (0.0%) 89,014 4,172K (0.9%) j.u.Properties 1 16K (0.0%) 1,737 4,133K (0.8%) java.util.concurrent.ConcurrentHashMap$Node[] 2,226 347K (0.1%) 4,973 3,150K (0.6%) byte[] 0 0K (0.0%) 88,088 3,440K (0.7%) org.apache.hadoop.hive.ql.plan.PartitionDesc 27,263 851K (0.2%) 86,535 2,576K (0.5%) String[] 27,032 844K (0.2%) 63,013 1,969K (0.4%) org.apache.hadoop.hive.ql.lockmgr.HiveLockObject$HiveLockObjectData 44 0K (0.0%) 176,447 2,756K (0.6%) j.u.HashMap$EntrySet 0 0K (0.0%) 88,000 2,750K (0.6%) org.apache.hadoop.hive.ql.metadata.Partition 27,032 633K (0.1%) 63,058 1,477K (0.3%) org.apache.hadoop.hive.ql.lockmgr.HiveLockObject 0 0K (0.0%) 89,233 2,091K (0.4%) org.apache.hadoop.hive.metastore.api.StorageDescriptor$_Fields[] 0 0K (0.0%) 89,230 2,091K (0.4%) org.apache.hadoop.hive.metastore.api.SkewedInfo 0 0K (0.0%) 89,230 2,091K (0.4%) org.apache.hadoop.hive.metastore.api.SerDeInfo 0 0K (0.0%) 89,188 2,090K (0.4%) org.apache.hadoop.hive.metastore.api.Partition$_Fields[] 38,019 891K (0.2%) 26,045 610K (0.1%) org.apache.hadoop.hive.ql.lockmgr.HiveLockObj 3,095 146K (0.0%) 1,578 1,297K (0.3%) int[] 160 60K (0.0%) 7,631 1,344K (0.3%) short[] 0 0K (0.0%) 88,248 1,378K (0.3%) j.u.LinkedHashSet 0 0K (0.0%) 55,605 1,303K (0.3%) org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLock 41 0K (0.0%) 62,669 979K (0.2%) org.apache.hadoop.fs.Path 75 1K (0.0%) 30,133 706K (0.1%) j.u.LinkedList$Node 5,243 450K (0.1%) 2,507 215K (0.0%) java.lang.reflect.Method =================================================== 3. OBJECT HEADERS Object header size: 12 bytes Total size of all object headers: 132,424K (27.2%) #instances (Average) object Total header Class name size size ------------------------------------------------------------- 2,199,986 32 25,781K (5.3%) j.u.Hashtable$Entry 1,427,776 24 16,731K (3.4%) org.apache.hadoop.hive.metastore.api.FieldSchema 1,101,947 111 12,913K (2.6%) char[] 1,093,250 24 12,811K (2.6%) String 745,212 32 8,732K (1.8%) j.u.HashMap$Node 719,609 24 8,432K (1.7%) j.u.ArrayList 367,487 74 4,306K (0.9%) Object[] 362,055 48 4,242K (0.9%) j.u.HashMap 355,564 40 4,166K (0.9%) j.u.LinkedHashMap$Entry 331,102 32 3,880K (0.8%) java.util.concurrent.ConcurrentHashMap$Node 269,691 88 3,160K (0.6%) j.u.HashMap$Node[] 177,427 56 2,079K (0.4%) j.u.LinkedHashMap 176,491 16 2,068K (0.4%) j.u.HashMap$EntrySet 113,798 30 1,333K (0.3%) String[] 90,329 248 1,058K (0.2%) j.u.Hashtable$Entry[] 90,090 24 1,055K (0.2%) org.apache.hadoop.hive.ql.lockmgr.HiveLockObject 90,045 32 1,055K (0.2%) org.apache.hadoop.hive.ql.lockmgr.HiveLockObject$HiveLockObjectData 89,233 24 1,045K (0.2%) org.apache.hadoop.hive.metastore.api.StorageDescriptor$_Fields[] 89,231 64 1,045K (0.2%) org.apache.hadoop.hive.metastore.api.StorageDescriptor 89,230 24 1,045K (0.2%) org.apache.hadoop.hive.metastore.api.SkewedInfo 89,230 24 1,045K (0.2%) org.apache.hadoop.hive.metastore.api.SerDeInfo 89,188 24 1,045K (0.2%) org.apache.hadoop.hive.metastore.api.Partition$_Fields[] 89,186 56 1,045K (0.2%) org.apache.hadoop.hive.metastore.api.Partition 89,014 48 1,043K (0.2%) j.u.Properties 88,248 16 1,034K (0.2%) j.u.LinkedHashSet 88,088 40 1,032K (0.2%) org.apache.hadoop.hive.ql.plan.PartitionDesc 88,045 56 1,031K (0.2%) org.apache.hadoop.hive.ql.hooks.ReadEntity 88,000 32 1,031K (0.2%) org.apache.hadoop.hive.ql.metadata.Partition 64,064 24 750K (0.2%) org.apache.hadoop.hive.ql.lockmgr.HiveLockObj 62,854 80 736K (0.2%) java.net.URI 62,710 16 734K (0.2%) org.apache.hadoop.fs.Path 55,605 24 651K (0.1%) org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLock =================================================== 4. REFERENCE CHAINS WITH HIGH RETAINED MEMORY (MAY SIGNAL MEMORY LEAK) 221,344K (45.4%) <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 221,273K (45.4%) <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 121,250K (24.9%) <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.QueryPlan.inputs <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 97,819K (20.1%) <-- org.apache.hadoop.hive.ql.metadata.Partition.tPartition <-- org.apache.hadoop.hive.ql.hooks.ReadEntity.p <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.QueryPlan.inputs <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 96,607K (19.8%) <-- org.apache.hadoop.hive.ql.plan.MapredWork.mapWork <-- org.apache.hadoop.hive.ql.exec.mr.MapRedTask.work <-- {j.u.ArrayList} <-- org.apache.hadoop.hive.ql.QueryPlan.rootTasks <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 73,137K (15.0%) <-- {j.u.LinkedHashMap}.values <-- org.apache.hadoop.hive.ql.plan.MapWork.pathToPartitionInfo <-- org.apache.hadoop.hive.ql.plan.MapredWork.mapWork <-- org.apache.hadoop.hive.ql.exec.mr.MapRedTask.work <-- {j.u.ArrayList} <-- org.apache.hadoop.hive.ql.QueryPlan.rootTasks <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 63,453K (13.0%) <-- org.apache.hadoop.hive.metastore.api.Partition.sd <-- org.apache.hadoop.hive.ql.metadata.Partition.tPartition <-- org.apache.hadoop.hive.ql.hooks.ReadEntity.p <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.QueryPlan.inputs <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 54,250K (11.1%) <-- org.apache.hadoop.hive.ql.plan.PartitionDesc.properties <-- {j.u.LinkedHashMap}.values <-- org.apache.hadoop.hive.ql.plan.MapWork.pathToPartitionInfo <-- org.apache.hadoop.hive.ql.plan.MapredWork.mapWork <-- org.apache.hadoop.hive.ql.exec.mr.MapRedTask.work <-- {j.u.ArrayList} <-- org.apache.hadoop.hive.ql.QueryPlan.rootTasks <-- org.apache.hadoop.hive.ql.Driver.plan <-- {j.u.LinkedHashMap}.values <-- org.apache.hadoop.hive.ql.plan.MapWork.pathToPartitionInfo <-- org.apache.hadoop.hive.ql.plan.MapredWork.mapWork <-- org.apache.hadoop.hive.ql.exec.mr.MapRedTask.work <-- {j.u.ArrayList} <-- org.apache.hadoop.hive.ql.QueryPlan.rootTasks <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots GC root stack trace: org.apache.hadoop.hive.ql.Driver.acquireLocksAndOpenTxn(Driver.java:1032) org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1308) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1127) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1120) org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:187) org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:76) org.apache.hive.service.cli.operation.SQLOperation$2$1.run(SQLOperation.java:241) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hive.service.cli.operation.SQLOperation$2.run(SQLOperation.java:254) java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) -------- 50,299K (10.3%) <-- Java Local (org.apache.hadoop.hive.ql.hooks.HookContext) [@e21c2328,@e2c6ece0,@e5057e98,@e5c4dc40] ... and 9 more GC roots 49,006K (10.1%) <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.hooks.HookContext.inputs <-- Java Local (org.apache.hadoop.hive.ql.hooks.HookContext) [@e21c2328,@e2c6ece0,@e5057e98,@e5c4dc40] ... and 9 more GC roots 39,203K (8.0%) <-- org.apache.hadoop.hive.ql.metadata.Partition.tPartition <-- org.apache.hadoop.hive.ql.hooks.ReadEntity.p <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.hooks.HookContext.inputs <-- Java Local (org.apache.hadoop.hive.ql.hooks.HookContext) [@e21c2328,@e2c6ece0,@e5057e98,@e5c4dc40] ... and 9 more GC roots 26,609K (5.5%) <-- org.apache.hadoop.hive.metastore.api.Partition.sd <-- org.apache.hadoop.hive.ql.metadata.Partition.tPartition <-- org.apache.hadoop.hive.ql.hooks.ReadEntity.p <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.hooks.HookContext.inputs <-- Java Local (org.apache.hadoop.hive.ql.hooks.HookContext) [@e21c2328,@e2c6ece0,@e5057e98,@e5c4dc40] ... and 9 more GC roots GC root stack trace: org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1538) org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1318) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1127) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1120) org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:187) org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:76) org.apache.hive.service.cli.operation.SQLOperation$2$1.run(SQLOperation.java:241) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hive.service.cli.operation.SQLOperation$2.run(SQLOperation.java:254) java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) -------- 22,034K (4.5%) <-- org.apache.hadoop.fs.Path.uri <-- org.apache.hadoop.fs.Path[] <-- Java Local (org.apache.hadoop.fs.Path[]) [@e0f09c88,@e0fd8288,@e1521570,@e1fe76b8] ... and 9 more GC roots GC root stack trace: org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getCombineSplits(CombineHiveInputFormat.java:472) org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:573) org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:332) org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:324) org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:200) org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307) org.apache.hadoop.mapreduce.Job$10.run(Job.java:1304) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hadoop.mapreduce.Job.submit(Job.java:1304) org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:578) org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:573) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:573) org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:564) org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:416) org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:140) org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100) org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1781) org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1538) org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1318) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1127) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1120) org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:187) org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:76) org.apache.hive.service.cli.operation.SQLOperation$2$1.run(SQLOperation.java:241) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hive.service.cli.operation.SQLOperation$2.run(SQLOperation.java:254) java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) -------- 20,969K (4.3%) <-- Java Static: org.apache.hadoop.conf.Configuration.REGISTRY 20,957K (4.3%) <-- {j.u.WeakHashMap}.keys <-- Java Static: org.apache.hadoop.conf.Configuration.REGISTRY -------- 16,918K (3.5%) <-- org.apache.hadoop.fs.Path.uri <-- {j.u.LinkedList} <-- Java Local (j.u.LinkedList) [@e21f6c70,@e2c9a0e0,@e509c070,@eccf2ed8] ... and 6 more GC roots GC root stack trace: org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:416) org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:140) org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100) org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1781) org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1538) org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1318) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1127) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1120) org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:187) org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:76) org.apache.hive.service.cli.operation.SQLOperation$2$1.run(SQLOperation.java:241) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hive.service.cli.operation.SQLOperation$2.run(SQLOperation.java:254) java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) -------- 16,234K (3.3%) <-- Java Local (j.u.LinkedList) [@e21f6c70,@e2c9a0e0,@eccf2ed8,@edf30b38] ... and 5 more GC roots GC root stack trace: org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:416) org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:140) org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100) org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1781) org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1538) org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1318) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1127) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1120) org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:187) org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:76) org.apache.hive.service.cli.operation.SQLOperation$2$1.run(SQLOperation.java:241) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hive.service.cli.operation.SQLOperation$2.run(SQLOperation.java:254) java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) -------- 15,151K (3.1%) <-- org.apache.hadoop.hive.ql.plan.PartitionDesc.properties <-- {j.u.LinkedHashMap}.values <-- Java Local (j.u.LinkedHashMap) [@f105f548,@f1614a78,@f1f77fd8,@f27fd190] ... and 4 more GC roots GC root stack trace: org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getCombineSplits(CombineHiveInputFormat.java:472) org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:573) org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:332) org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:324) org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:200) org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307) org.apache.hadoop.mapreduce.Job$10.run(Job.java:1304) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hadoop.mapreduce.Job.submit(Job.java:1304) org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:578) org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:573) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:573) org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:564) org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:416) org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:140) org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100) org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1781) org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1538) org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1318) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1127) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1120) org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:187) org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:76) org.apache.hive.service.cli.operation.SQLOperation$2$1.run(SQLOperation.java:241) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hive.service.cli.operation.SQLOperation$2.run(SQLOperation.java:254) java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) -------- 13,191K (2.7%) <-- Unreachable 7,847K (1.6%) <-- {j.u.ArrayList} <-- Unreachable 6,955K (1.4%) <-- org.apache.hadoop.hive.ql.lockmgr.HiveLockObj.obj <-- {j.u.ArrayList} <-- Unreachable -------- 12,966K (2.7%) <-- Java Local (j.u.LinkedHashMap) [@f105f548,@f1614a78,@f1f77fd8,@f27fd190] 10,964K (2.2%) <-- {j.u.LinkedHashMap}.values <-- Java Local (j.u.LinkedHashMap) [@f105f548,@f1614a78,@f1f77fd8,@f27fd190] GC root stack trace: org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getCombineSplits(CombineHiveInputFormat.java:472) org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:573) org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:332) org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:324) org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:200) org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307) org.apache.hadoop.mapreduce.Job$10.run(Job.java:1304) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hadoop.mapreduce.Job.submit(Job.java:1304) org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:578) org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:573) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:573) org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:564) org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:416) org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:140) org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100) org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1781) org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1538) org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1318) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1127) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1120) org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:187) org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:76) org.apache.hive.service.cli.operation.SQLOperation$2$1.run(SQLOperation.java:241) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hive.service.cli.operation.SQLOperation$2.run(SQLOperation.java:254) java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) -------- 12,613K (2.6%) <-- Java Local (org.apache.hadoop.hive.ql.plan.MapWork) [@ee64bea0,@f0fa0228,@f0fa05b8,@f13dc0c8] GC root stack trace: org.apache.hadoop.hive.ql.exec.Utilities.getInputPaths(Utilities.java:3370) org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:358) org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:140) org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100) org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1781) org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1538) org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1318) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1127) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1120) org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:187) org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:76) org.apache.hive.service.cli.operation.SQLOperation$2$1.run(SQLOperation.java:241) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hive.service.cli.operation.SQLOperation$2.run(SQLOperation.java:254) java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) -------- 12,605K (2.6%) <-- {j.u.LinkedHashMap}.values <-- org.apache.hadoop.hive.ql.plan.MapWork.pathToPartitionInfo <-- Java Local (org.apache.hadoop.hive.ql.plan.MapWork) [@ee64bea0,@f0fa0228,@f0fa05b8,@f0fa06e8] ... and 1 more GC roots 8,828K (1.8%) <-- org.apache.hadoop.hive.ql.plan.PartitionDesc.properties <-- {j.u.LinkedHashMap}.values <-- org.apache.hadoop.hive.ql.plan.MapWork.pathToPartitionInfo <-- Java Local (org.apache.hadoop.hive.ql.plan.MapWork) [@ee64bea0,@f0fa0228,@f0fa05b8,@f0fa06e8] ... and 1 more GC roots GC root stack trace: org.apache.hadoop.hive.ql.exec.Utilities.getInputPaths(Utilities.java:3370) org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:358) org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:140) org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100) org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1781) org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1538) org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1318) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1127) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1120) org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:187) org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:76) org.apache.hive.service.cli.operation.SQLOperation$2$1.run(SQLOperation.java:241) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hive.service.cli.operation.SQLOperation$2.run(SQLOperation.java:254) java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) -------- 12,360K (2.5%) <-- Java Local (j.u.ArrayList) [@e14a6250,@e1960280,@e413aef0,@e6f58ca0] ... and 3 more GC roots 12,080K (2.5%) <-- org.apache.hadoop.fs.Path.uri <-- {j.u.ArrayList} <-- Java Local (j.u.ArrayList) [@e14a6250,@e1960280,@e413aef0,@e6f58ca0] ... and 3 more GC roots GC root stack trace: org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:573) org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:332) org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:324) org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:200) org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307) org.apache.hadoop.mapreduce.Job$10.run(Job.java:1304) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hadoop.mapreduce.Job.submit(Job.java:1304) org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:578) org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:573) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:573) org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:564) org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:416) org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:140) org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100) org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1781) org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1538) org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1318) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1127) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1120) org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:187) org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:76) org.apache.hive.service.cli.operation.SQLOperation$2$1.run(SQLOperation.java:241) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hive.service.cli.operation.SQLOperation$2.run(SQLOperation.java:254) java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) -------- 8,508K (1.7%) <-- Java Local (j.u.LinkedHashMap) [@f34b5a08,@f4057f70,@f4943940] 7,819K (1.6%) <-- {j.u.LinkedHashMap}.values <-- Java Local (j.u.LinkedHashMap) [@f34b5a08,@f4057f70,@f4943940] GC root stack trace: org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getCombineSplits(CombineHiveInputFormat.java:390) org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:573) org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:332) org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:324) org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:200) org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307) org.apache.hadoop.mapreduce.Job$10.run(Job.java:1304) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hadoop.mapreduce.Job.submit(Job.java:1304) org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:578) org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:573) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:573) org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:564) org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:416) org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:140) org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100) org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1781) org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1538) org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1318) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1127) org.apache.hadoop.hive.ql.Driver.run(Driver.java:1120) org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:187) org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:76) org.apache.hive.service.cli.operation.SQLOperation$2$1.run(SQLOperation.java:241) java.security.AccessController.doPrivileged(Native method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) org.apache.hive.service.cli.operation.SQLOperation$2.run(SQLOperation.java:254) java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) =================================================== 5. VERY LONG (OVER 1000 ELEMENTS) REFERENCE CHAINS 0K (0.0%), ref chain length: 2206 <-- j.l.r.Finalizer.next <-- j.l.r.Finalizer.next <-- j.l.r.Finalizer.next <-- j.l.r.Finalizer.next <-- j.l.r.Finalizer.next <-- j.l.r.Finalizer.next <-- j.l.r.Finalizer.next <-- j.l.r.Finalizer.next <-- ... (2190 elements) ... <-- j.l.r.Finalizer.next <-- j.l.r.Finalizer.next <-- j.l.r.Finalizer.next <-- j.l.r.Finalizer.next <-- j.l.r.Finalizer.next <-- j.l.r.Finalizer.next <-- j.l.r.Finalizer.next <-- Java Static: java.lang.ref.Finalizer.unfinalized =================================================== 6. DUPLICATE STRINGS Total strings: 1,093,250 Unique strings: 110,209 Duplicate values: 22,317 Overhead: 119,349K (24.5%) Top duplicate strings: Ovhd Num char[]s Num objs Value 7,329K (1.5%) 62542 62542 "host-10-17-101-14.coe.cloudera.com:8020" 6,867K (1.4%) 62794 62794 "host-10-17-101-14.coe.cloudera.com" 5,216K (1.1%) 17 17 "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-1,hdf ...[length 166892]" 2,930K (0.6%) 62526 62526 "hdfs" 650K (0.1%) 11898 11898 "string" =================================================== 7. REFERENCE CHAINS FOR DUPLICATE STRINGS 12,451K (2.6%), 62000 dup strings (2000 unique), 62000 dup backing arrays: 31 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 31 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 31 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 82]", 31 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 82]", 31 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 31 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 31 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 31 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 82]", 31 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 31 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 82]" ... and 61380 more strings, of which 1990 are unique <-- {j.u.LinkedHashMap}.keys <-- org.apache.hadoop.hive.ql.plan.MapWork.pathToAliases <-- org.apache.hadoop.hive.ql.plan.MapredWork.mapWork <-- org.apache.hadoop.hive.ql.exec.mr.MapRedTask.work <-- {j.u.ArrayList} <-- org.apache.hadoop.hive.ql.QueryPlan.rootTasks <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 8,515K (1.7%), 62031 dup strings (2001 unique), 62031 dup backing arrays: 31 of "default@misha_table@partition_field=partition-1952", 31 of "default@misha_table@partition_field=partition-1299", 31 of "default@misha_table@partition_field=partition-1120", 31 of "default@misha_table@partition_field=partition-1382", 31 of "default@misha_table@partition_field=partition-1737", 31 of "default@misha_table@partition_field=partition-1605", 31 of "default@misha_table@partition_field=partition-223", 31 of "default@misha_table@partition_field=partition-1167", 31 of "default@misha_table@partition_field=partition-1250", 31 of "default@misha_table@partition_field=partition-1037" ... and 61411 more strings, of which 1991 are unique <-- org.apache.hadoop.hive.ql.hooks.ReadEntity.name <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.QueryPlan.inputs <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 5,667K (1.2%), 62000 dup strings (2000 unique), 62000 dup backing arrays: 31 of "misha-table-partition-453", 31 of "misha-table-partition-1276", 31 of "misha-table-partition-808", 31 of "misha-table-partition-1846", 31 of "misha-table-partition-1714", 31 of "misha-table-partition-238", 31 of "misha-table-partition-108", 31 of "misha-table-partition-106", 31 of "misha-table-partition-1976", 31 of "misha-table-partition-321" ... and 61380 more strings, of which 1990 are unique <-- org.apache.hadoop.hive.ql.plan.PartitionDesc.baseFileName <-- {j.u.LinkedHashMap}.values <-- org.apache.hadoop.hive.ql.plan.MapWork.pathToPartitionInfo <-- org.apache.hadoop.hive.ql.plan.MapredWork.mapWork <-- org.apache.hadoop.hive.ql.exec.mr.MapRedTask.work <-- {j.u.ArrayList} <-- org.apache.hadoop.hive.ql.QueryPlan.rootTasks <-- org.apache.hadoop.hive.ql.Driver.plan <-- {j.u.LinkedHashMap}.values <-- org.apache.hadoop.hive.ql.plan.MapWork.pathToPartitionInfo <-- org.apache.hadoop.hive.ql.plan.MapredWork.mapWork <-- org.apache.hadoop.hive.ql.exec.mr.MapRedTask.work <-- {j.u.ArrayList} <-- org.apache.hadoop.hive.ql.QueryPlan.rootTasks <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 5,202K (1.1%), 25992 dup strings (2000 unique), 25992 dup backing arrays: 13 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 13 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 13 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 82]", 13 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 82]", 13 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 13 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 13 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 13 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 82]", 13 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 13 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 82]" ... and 25740 more strings, of which 1990 are unique <-- java.net.URI.string <-- org.apache.hadoop.fs.Path.uri <-- org.apache.hadoop.fs.Path[] <-- Java Local (org.apache.hadoop.fs.Path[]) [@e0f09c88,@e0fd8288,@e1521570,@e1fe76b8] ... and 9 more GC roots 4,900K (1.0%), 25992 dup strings (2000 unique), 25992 dup backing arrays: 13 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-1533", 13 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-1318", 13 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-1095", 13 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-304", 13 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-566", 13 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-53", 13 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-436", 13 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-1665", 13 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-651", 13 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-1795" ... and 25740 more strings, of which 1990 are unique <-- java.net.URI.schemeSpecificPart <-- org.apache.hadoop.fs.Path.uri <-- org.apache.hadoop.fs.Path[] <-- Java Local (org.apache.hadoop.fs.Path[]) [@e0f09c88,@e0fd8288,@e1521570,@e1fe76b8] ... and 9 more GC roots 4,248K (0.9%), 62000 dup strings (2000 unique), 62000 dup backing arrays: 31 of "partition-1363", 31 of "partition-611", 31 of "partition-1148", 31 of "partition-1718", 31 of "partition-528", 31 of "partition-173", 31 of "partition-1933", 31 of "partition-1101", 31 of "partition-1016", 31 of "partition-1495" ... and 61380 more strings, of which 1990 are unique <-- {j.u.ArrayList} <-- org.apache.hadoop.hive.metastore.api.Partition.values <-- org.apache.hadoop.hive.ql.metadata.Partition.tPartition <-- org.apache.hadoop.hive.ql.hooks.ReadEntity.p <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.QueryPlan.inputs <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 3,973K (0.8%), 19851 dup strings (2000 unique), 19851 dup backing arrays: 11 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 11 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 11 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 11 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 11 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 11 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 11 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 11 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 11 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]", 11 of "hdfs://host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-t ...[length 83]" ... and 19651 more strings, of which 1990 are unique <-- java.net.URI.string <-- org.apache.hadoop.fs.Path.uri <-- {j.u.LinkedList} <-- Java Local (j.u.LinkedList) [@e21f6c70,@e2c9a0e0,@e509c070,@e8599ac8] ... and 7 more GC roots 3,747K (0.8%), 19851 dup strings (2000 unique), 19851 dup backing arrays: 11 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-1095", 11 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-1050", 11 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-10", 11 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-1186", 11 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-1141", 11 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-1058", 11 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-1054", 11 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-1099", 11 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-1182", 11 of "//host-10-17-101-14.coe.cloudera.com:8020/tmp/misha/misha-table-partition-1091" ... and 19651 more strings, of which 1990 are unique <-- java.net.URI.schemeSpecificPart <-- org.apache.hadoop.fs.Path.uri <-- {j.u.LinkedList} <-- Java Local (j.u.LinkedList) [@e21f6c70,@e2c9a0e0,@e509c070,@e8599ac8] ... and 7 more GC roots 3,548K (0.7%), 26013 dup strings (2001 unique), 26013 dup backing arrays: 13 of "default@misha_table@partition_field=partition-1952", 13 of "default@misha_table@partition_field=partition-1299", 13 of "default@misha_table@partition_field=partition-1120", 13 of "default@misha_table@partition_field=partition-1382", 13 of "default@misha_table@partition_field=partition-1737", 13 of "default@misha_table@partition_field=partition-1605", 13 of "default@misha_table@partition_field=partition-223", 13 of "default@misha_table@partition_field=partition-1167", 13 of "default@misha_table@partition_field=partition-1250", 13 of "default@misha_table@partition_field=partition-1037" ... and 25753 more strings, of which 1991 are unique <-- org.apache.hadoop.hive.ql.hooks.ReadEntity.name <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.hooks.HookContext.inputs <-- Java Local (org.apache.hadoop.hive.ql.hooks.HookContext) [@e21c2328,@e2c6ece0,@e5057e98,@e5c4dc40] ... and 9 more GC roots 3,045K (0.6%), 25992 dup strings (1 unique), 25992 dup backing arrays: 25992 of "host-10-17-101-14.coe.cloudera.com:8020" <-- java.net.URI.authority <-- org.apache.hadoop.fs.Path.uri <-- org.apache.hadoop.fs.Path[] <-- Java Local (org.apache.hadoop.fs.Path[]) [@e0f09c88,@e0fd8288,@e1521570,@e1fe76b8] ... and 9 more GC roots =================================================== 8. BAD COLLECTIONS Total collections: 1,443,560 Bad collections: 1,084,918 Overhead: 89,439K (18.3%) Top bad collections: Ovhd Problem Num objs Type ------------------------------------------------- 21,027K (4.3%) 1-elem 270286 j.u.ArrayList 15,191K (3.1%) 1-elem 88393 j.u.LinkedHashMap 14,710K (3.0%) small 89926 j.u.HashMap 14,628K (3.0%) empty 2142 java.util.concurrent.ConcurrentHashMap 8,486K (1.7%) empty 180886 j.u.HashMap 8,457K (1.7%) empty 358499 j.u.ArrayList 6,194K (1.3%) empty 88097 j.u.LinkedHashSet =================================================== 9. REFERENCE CHAINS FOR BAD COLLECTIONS 10,656K (2.2%): j.u.LinkedHashMap: 62000 of 1-elem 10,656K (2.2%) <-- org.apache.hadoop.hive.ql.plan.PartitionDesc.partSpec <-- {j.u.LinkedHashMap}.values <-- org.apache.hadoop.hive.ql.plan.MapWork.pathToPartitionInfo <-- org.apache.hadoop.hive.ql.plan.MapredWork.mapWork <-- org.apache.hadoop.hive.ql.exec.mr.MapRedTask.work <-- {j.u.ArrayList} <-- org.apache.hadoop.hive.ql.QueryPlan.rootTasks <-- org.apache.hadoop.hive.ql.Driver.plan <-- {j.u.LinkedHashMap}.values <-- org.apache.hadoop.hive.ql.plan.MapWork.pathToPartitionInfo <-- org.apache.hadoop.hive.ql.plan.MapredWork.mapWork <-- org.apache.hadoop.hive.ql.exec.mr.MapRedTask.work <-- {j.u.ArrayList} <-- org.apache.hadoop.hive.ql.QueryPlan.rootTasks <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 10,171K (2.1%): j.u.HashMap: 62000 of small 10,171K (2.1%) <-- org.apache.hadoop.hive.metastore.api.SerDeInfo.parameters <-- org.apache.hadoop.hive.metastore.api.StorageDescriptor.serdeInfo <-- org.apache.hadoop.hive.metastore.api.Partition.sd <-- org.apache.hadoop.hive.ql.metadata.Partition.tPartition <-- org.apache.hadoop.hive.ql.hooks.ReadEntity.p <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.QueryPlan.inputs <-- org.apache.hadoop.hive.ql.Driver.plan <-- org.apache.hadoop.hive.metastore.api.StorageDescriptor.serdeInfo <-- org.apache.hadoop.hive.metastore.api.Partition.sd <-- org.apache.hadoop.hive.ql.metadata.Partition.tPartition <-- org.apache.hadoop.hive.ql.hooks.ReadEntity.p <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.QueryPlan.inputs <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 5,493K (1.1%): java.util.concurrent.ConcurrentHashMap: 99 of empty 5,493K (1.1%) <-- org.apache.hadoop.hive.conf.HiveConf.updatingResource <-- {j.u.WeakHashMap}.keys <-- Java Static: org.apache.hadoop.conf.Configuration.REGISTRY 4,846K (1.0%): j.u.ArrayList: 62031 of 1-elem 4,846K (1.0%) <-- org.apache.hadoop.hive.ql.hooks.ReadEntity.accessedColumns <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.QueryPlan.inputs <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 4,843K (1.0%): j.u.ArrayList: 62000 of 1-elem 4,843K (1.0%) <-- {j.u.LinkedHashMap}.values <-- org.apache.hadoop.hive.ql.plan.MapWork.pathToAliases <-- org.apache.hadoop.hive.ql.plan.MapredWork.mapWork <-- org.apache.hadoop.hive.ql.exec.mr.MapRedTask.work <-- {j.u.ArrayList} <-- org.apache.hadoop.hive.ql.QueryPlan.rootTasks <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 4,843K (1.0%): j.u.ArrayList: 62000 of 1-elem 4,843K (1.0%) <-- org.apache.hadoop.hive.metastore.api.Partition.values <-- org.apache.hadoop.hive.ql.metadata.Partition.tPartition <-- org.apache.hadoop.hive.ql.hooks.ReadEntity.p <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.QueryPlan.inputs <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 4,361K (0.9%): j.u.LinkedHashSet: 62031 of empty 4,361K (0.9%) <-- org.apache.hadoop.hive.ql.hooks.ReadEntity.parents <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.QueryPlan.inputs <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 4,265K (0.9%): j.u.HashMap: 26000 of small 4,265K (0.9%) <-- org.apache.hadoop.hive.metastore.api.SerDeInfo.parameters <-- org.apache.hadoop.hive.metastore.api.StorageDescriptor.serdeInfo <-- org.apache.hadoop.hive.metastore.api.Partition.sd <-- org.apache.hadoop.hive.ql.metadata.Partition.tPartition <-- org.apache.hadoop.hive.ql.hooks.ReadEntity.p <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.hooks.HookContext.inputs <-- Java Local (org.apache.hadoop.hive.ql.hooks.HookContext) [@e21c2328,@e2c6ece0,@e5057e98,@e5c4dc40] ... and 9 more GC roots 2,906K (0.6%): j.u.HashMap: 62000 of empty 2,906K (0.6%) <-- org.apache.hadoop.hive.metastore.api.StorageDescriptor.parameters <-- org.apache.hadoop.hive.metastore.api.Partition.sd <-- org.apache.hadoop.hive.ql.metadata.Partition.tPartition <-- org.apache.hadoop.hive.ql.hooks.ReadEntity.p <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.QueryPlan.inputs <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 2,906K (0.6%): j.u.HashMap: 62000 of empty 2,906K (0.6%) <-- org.apache.hadoop.hive.metastore.api.SkewedInfo.skewedColValueLocationMaps <-- org.apache.hadoop.hive.metastore.api.StorageDescriptor.skewedInfo <-- org.apache.hadoop.hive.metastore.api.Partition.sd <-- org.apache.hadoop.hive.ql.metadata.Partition.tPartition <-- org.apache.hadoop.hive.ql.hooks.ReadEntity.p <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.QueryPlan.inputs <-- org.apache.hadoop.hive.ql.Driver.plan <-- org.apache.hadoop.hive.metastore.api.StorageDescriptor.skewedInfo <-- org.apache.hadoop.hive.metastore.api.Partition.sd <-- org.apache.hadoop.hive.ql.metadata.Partition.tPartition <-- org.apache.hadoop.hive.ql.hooks.ReadEntity.p <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.QueryPlan.inputs <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots =================================================== 10. BAD OBJECT ARRAYS Total object arrays: 1,047,798 Bad object arrays: 131,102 Overhead: 4,588K (0.9%) Top bad object arrays: Ovhd Problem Num objs Type --------------------------------------------------- 2,090K (0.4%) 1-length 89186 org.apache.hadoop.hive.metastore.api.Partition$_Fields[] 1,205K (0.2%) empty 1081 Object[] =================================================== 11. REFERENCE CHAINS FOR BAD OBJECT ARRAYS 1,453K (0.3%): org.apache.hadoop.hive.metastore.api.Partition$_Fields[]: 62000 of 1-length 1,453K (0.3%) <-- org.apache.hadoop.hive.metastore.api.Partition.optionals <-- org.apache.hadoop.hive.ql.metadata.Partition.tPartition <-- org.apache.hadoop.hive.ql.hooks.ReadEntity.p <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.QueryPlan.inputs <-- org.apache.hadoop.hive.ql.Driver.plan <-- Java Local (org.apache.hadoop.hive.ql.Driver) [@ef2c6400,@ef2c6458,@ef2c6560,@ef2c65b8] ... and 27 more GC roots 1,152K (0.2%): Object[]: 9 of empty 1,152K (0.2%) <-- org.apache.hive.com.esotericsoftware.kryo.util.IdentityObjectIntMap.keyTable <-- org.apache.hive.com.esotericsoftware.kryo.util.MapReferenceResolver.writtenObjects <-- org.apache.hive.com.esotericsoftware.kryo.Kryo.referenceResolver <-- j.l.ThreadLocal$ThreadLocalMap$Entry.value <-- j.l.ThreadLocal$ThreadLocalMap$Entry[] <-- j.l.ThreadLocal$ThreadLocalMap.table <-- org.apache.hive.service.server.ThreadWithGarbageCleanup.threadLocals <-- Java Local (org.apache.hive.service.server.ThreadWithGarbageCleanup) [@f0556e70,@f0556ff0,@f1f1d110,@f1f1d290] ... and 5 more GC roots 609K (0.1%): org.apache.hadoop.hive.metastore.api.Partition$_Fields[]: 26000 of 1-length 609K (0.1%) <-- org.apache.hadoop.hive.metastore.api.Partition.optionals <-- org.apache.hadoop.hive.ql.metadata.Partition.tPartition <-- org.apache.hadoop.hive.ql.hooks.ReadEntity.p <-- {j.u.LinkedHashSet} <-- org.apache.hadoop.hive.ql.hooks.HookContext.inputs <-- Java Local (org.apache.hadoop.hive.ql.hooks.HookContext) [@e21c2328,@e2c6ece0,@e5057e98,@e5c4dc40] ... and 9 more GC roots =================================================== 12. BOXED NUMBERS Total boxed number objects: 31,210 Overhead: 606K (0.1%) Top boxed number objects: Ovhd Size Num objs Type ------------------------------------------------------ =================================================== 13. REFERENCE CHAINS FOR BOXED NUMBERS =================================================== 14. DUPLICATE PRIMITIVE ARRAYS Total arrays: 31,072 Unique arrays: 6,269 Duplicate values: 1,065 Overhead: 5,790K (1.2%) Top duplicate arrays: Ovhd Num objs Value 2,338K (0.5%) 147 char[8192](, , , , , , , , , , ...) 1,322K (0.3%) 166 byte[8192](0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ...) =================================================== 15. REFERENCE CHAINS FOR DUPLICATE PRIMITIVE ARRAYS 715K (0.1%), 45 dup arrays (1 unique) 45 of char[8192](, , , , , , , , , , ...) <-- java.io.BufferedWriter.cb <-- java.io.PrintStream.textOut <-- org.apache.hadoop.hive.ql.session.SessionState.err <-- Java Local (org.apache.hadoop.hive.ql.session.SessionState) [@eecb0100,@eecb01c0,@eecb0280,@eecb0340] ... and 41 more GC roots 715K (0.1%), 45 dup arrays (1 unique) 45 of char[8192](, , , , , , , , , , ...) <-- java.io.BufferedWriter.cb <-- java.io.PrintStream.textOut <-- org.apache.hadoop.hive.ql.session.SessionState.out <-- Java Local (org.apache.hadoop.hive.ql.session.SessionState) [@eecb0100,@eecb01c0,@eecb0280,@eecb0340] ... and 41 more GC roots 553K (0.1%), 543 dup arrays (11 unique) 303 of short[0](), 224 of short[75](52, 52, 52, 52, 52, 52, 52, 52, 52, 52, ...), 3 of short[65536](167, 167, 167, 167, 167, 167, 167, 167, 167, 167, ...), 3 of short[65536](170, 170, 170, 170, 170, 170, 170, 170, 170, 170, ...), 2 of short[54](370, 370, 370, 370, 370, 370, 370, 370, 370, 370, ...), 2 of short[77](178, -1, 175, 175, 175, 175, 175, 175, 175, 175, ...), 2 of short[6](49, -1, -1, -1, -1, 48), 1 of short[1](320), 1 of short[1](449), 1 of short[1](776) ... and 0 more arrays, of which 1 are unique <-- short[][] <-- Java Static: org.apache.hadoop.hive.ql.parse.HiveLexer.DFA25_transition 509K (0.1%), 32 dup arrays (1 unique) 32 of char[8192](, , , , , , , , , , ...) <-- java.io.BufferedWriter.cb <-- java.io.PrintStream.textOut <-- org.apache.hadoop.hive.ql.session.SessionState.info <-- Java Local (org.apache.hadoop.hive.ql.session.SessionState) [@eecb0100,@eecb01c0,@eecb0280,@eecb0340] ... and 28 more GC roots 505K (0.1%), 10029 dup arrays (216 unique) 2773 of int[0](), 2377 of char[34](d, e, f, a, u, l, t, /, m, i, ...), 2376 of char[16](d, e, f, a, u, l, t, /, , , ...), 293 of byte[6](115, 116, 114, 105, 110, 103), 177 of byte[3](105, 110, 116), 130 of char[16](, , , , , , , , , , ...), 60 of byte[2](45, 49), 60 of byte[2](52, 52), 32 of byte[5](102, 97, 108, 115, 101), 30 of byte[7](110, 117, 109, 82, 111, 119, 115) ... and 1711 more arrays, of which 206 are unique <-- Unreachable =======>>> All or some objects may come from: 7K (0.0%), 338 dup arrays (1 unique) 338 of byte[1](63) <-- sun.nio.cs.UTF_8$Encoder.replacement <-- java.util.zip.ZipCoder.enc <-- java.util.jar.JarFile.zc <-- sun.misc.URLClassPath$JarLoader.jar <-- {j.u.HashMap}.values <-- sun.misc.URLClassPath$JarLoader.lmap <-- Java Local@eb670d20 (sun.misc.URLClassPath$JarLoader) 4K (0.0%), 209 dup arrays (1 unique) 209 of byte[1](63) <-- sun.nio.cs.UTF_8$Encoder.replacement <-- java.util.zip.ZipCoder.enc <-- java.util.jar.JarFile.zc <-- sun.misc.URLClassPath$JarLoader.jar <-- {j.u.ArrayList} <-- sun.misc.URLClassPath.loaders <-- java.net.URLClassLoader.ucp <-- {j.u.WeakHashMap}.keys <-- java.util.zip.ZipCoder.enc <-- java.util.jar.JarFile.zc <-- sun.misc.URLClassPath$JarLoader.jar <-- {j.u.ArrayList} <-- sun.misc.URLClassPath.loaders <-- java.net.URLClassLoader.ucp <-- {j.u.WeakHashMap}.keys <-- Java Static: org.apache.hadoop.conf.Configuration.CACHE_CLASSES 3K (0.0%), 240 dup arrays (1 unique) 240 of short[0]() <-- short[][] <-- Java Static: org.apache.hadoop.hive.ql.parse.HiveParser_SelectClauseParser.DFA2_transition 2K (0.0%), 150 dup arrays (1 unique) 150 of short[0]() <-- short[][] <-- Java Static: org.apache.hadoop.hive.ql.parse.HiveParser.DFA12_transition <<<==========================================