Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-11023

Processing data bag on GridMarshallerMappingProcessor consume many time

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.8
    • None
    • None

    Description

      I have measure a processing data bag time on each join node and discovered what GridMarshallerMappingProcessor consume more time then others.

      It slow down on collecting topology, in particular case if joining some nodes. 

      2019-01-11 20:35:01.207 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Starting processing discovery data bag
2019-01-11 20:35:01.207 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component ClusterProcessor processed joining node data bag in 0ms
2019-01-11 20:35:01.207 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgnitePluginProcessor processed joining node data bag in 0ms
2019-01-11 20:35:01.208 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component CacheObjectBinaryProcessorImpl processed joining node data bag in 0ms
2019-01-11 20:35:01.208 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgniteAuthenticationProcessor processed joining node data bag in 0ms
2019-01-11 20:35:01.219 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridCacheProcessor processed joining node data bag in 10ms
2019-01-11 20:35:01.219 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridQueryProcessor processed joining node data bag in 0ms
2019-01-11 20:35:01.219 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridContinuousProcessor processed joining node data bag in 0ms
2019-01-11 20:35:01.463 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridMarshallerMappingProcessor processed joining node data bag in 242ms
2019-01-11 20:35:01.463 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Total time of processing discovery data bag: 252ms
2019-01-11 20:35:01.780 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Starting processing discovery data bag
2019-01-11 20:35:01.781 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component ClusterProcessor processed joining node data bag in 0ms
2019-01-11 20:35:01.781 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgnitePluginProcessor processed joining node data bag in 0ms
2019-01-11 20:35:01.781 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component CacheObjectBinaryProcessorImpl processed joining node data bag in 0ms
2019-01-11 20:35:01.781 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgniteAuthenticationProcessor processed joining node data bag in 0ms
2019-01-11 20:35:01.791 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridCacheProcessor processed joining node data bag in 10ms
2019-01-11 20:35:01.792 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridQueryProcessor processed joining node data bag in 0ms
2019-01-11 20:35:01.792 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridContinuousProcessor processed joining node data bag in 0ms
2019-01-11 20:35:02.134 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridMarshallerMappingProcessor processed joining node data bag in 338ms
2019-01-11 20:35:02.134 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Total time of processing discovery data bag: 348ms
2019-01-11 20:35:02.326 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Starting processing discovery data bag
2019-01-11 20:35:02.326 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component ClusterProcessor processed joining node data bag in 0ms
2019-01-11 20:35:02.326 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgnitePluginProcessor processed joining node data bag in 0ms
2019-01-11 20:35:02.326 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component CacheObjectBinaryProcessorImpl processed joining node data bag in 0ms
2019-01-11 20:35:02.326 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgniteAuthenticationProcessor processed joining node data bag in 0ms
2019-01-11 20:35:02.337 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridCacheProcessor processed joining node data bag in 10ms
2019-01-11 20:35:02.337 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridQueryProcessor processed joining node data bag in 0ms
2019-01-11 20:35:02.337 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridContinuousProcessor processed joining node data bag in 0ms
2019-01-11 20:35:02.574 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridMarshallerMappingProcessor processed joining node data bag in 242ms
2019-01-11 20:35:02.574 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Total time of processing discovery data bag: 252ms
2019-01-11 20:35:02.980 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Starting processing discovery data bag
2019-01-11 20:35:02.980 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component ClusterProcessor processed joining node data bag in 0ms
2019-01-11 20:35:02.980 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgnitePluginProcessor processed joining node data bag in 0ms
2019-01-11 20:35:02.980 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component CacheObjectBinaryProcessorImpl processed joining node data bag in 0ms
2019-01-11 20:35:02.980 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgniteAuthenticationProcessor processed joining node data bag in 0ms
2019-01-11 20:35:02.990 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridCacheProcessor processed joining node data bag in 10ms
2019-01-11 20:35:02.990 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridQueryProcessor processed joining node data bag in 0ms
2019-01-11 20:35:02.990 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridContinuousProcessor processed joining node data bag in 0ms
2019-01-11 20:35:03.224 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridMarshallerMappingProcessor processed joining node data bag in 231ms
2019-01-11 20:35:03.224 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Total time of processing discovery data bag: 241ms

      Attachments

        Issue Links

          links to

          Web Link GitHub Pull Request #5887

          Activity

            People

              v.pyatkov Vladislav Pyatkov
              v.pyatkov Vladislav Pyatkov
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m