Details
Critical Description
We have recently upgraded from 2.7.6 to 2.14 due to the issue observed in production environment where cluster would go in hang state due to partition map exchange.
Please find the below ticket which i created a while back for ignite 2.7.6
https://issues.apache.org/jira/browse/IGNITE-13298
So we migrated the apache ignite version to 2.14 and upgrade happened smoothly but on the third day we could see cluster traffic dip again.
We have 5 nodes in a cluster where we provide 400 GB of RAM and more than 1 TB SDD.
PFB for the attached config.[I have added it as attachment for review]
I have also added the server logs from the same time when issue happened.
We have set txn timeout as well as socket timeout both at server and client end for our write operations but seems like sometimes cluster goes into hang state and all our get calls are stuck and slowly everything starts to freeze our jms listener threads and every thread reaches a choked up state in sometime.
Due to which our read services which does not even use txn to retrieve data also starts to choke. Ultimately leading to end user traffic dip.
We were hoping product upgrade will help but that has not been the case till now.
