[TEZ-4455] Add LoggingHandler in ShuffleHandler pipeline for better debuggability

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.10.3
• Assignee: Dmitriy Fingerman
• Reporter: Dmitriy Fingerman
• Created: 22/Nov/22 17:18
• Updated: 23/Nov/22 19:26
• Resolved: 23/Nov/22 19:26

Description

https://github.com/apache/tez/blob/8bb27b845ce103b8d02a9a9d7fe2a1af10097e9c/tez-plugins/tez-aux-services/src/main/java/org/apache/tez/auxservices/ShuffleHandler.java#L598

 

For corner case debugging, it would be helpful to understand when netty processed OPEN/BOUND/CLOSE/RECEIVED/CONNECTED events along with payload details.

Adding "LoggingHandler" in ChannelPipeline mode can help in debugging.

 

An equivalent change was added to Hive recently https://issues.apache.org/jira/browse/HIVE-23754

Now adding similar improvement to Tez.

Issue Links

• is related to: HIVE-23754 LLAP: Add LoggingHandler in ShuffleHandler pipeline for better debuggability
• links to: GitHub Pull Request #249