[CARBONDATA-1913] Global Sort data dataload fails for big with RPC timeout exception

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Assignee: Mohammad Shahid Khan
• Reporter: Mohammad Shahid Khan
• Created: 19/Dec/17 13:42
• Updated: 30/Jan/18 11:12
• Resolved: 20/Dec/17 13:07

Description

When gloabl sort option is used for big data then for some times it fails with
RPC timeout after 120s.

This is happening because the driver is not able to unpersist rdd cache with in 120s.
The issue is happening due to rdd unpersist blocking call. Sometimes spark is not able
to unppersist the rdd in default "spark.rpc.askTimeout" or "spark.network.timeout" time.

Issue Links

• Blocked: CARBONDATA-1507 Dataload global sort fails with RpcTimeOutException: Futures timed out after [120 seconds]
• links to: GitHub Pull Request #1685