[HDFS-1640] Transmission of large files in compressed format will save the network traffic and can improve the data transfer time.

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: datanode, hdfs-client
• Assignee: Uma Maheswara Rao G
• Reporter: Uma Maheswara Rao G
• Created: 24/Feb/11 10:31
• Updated: 17/Jul/23 16:31

Description

In Write scenario:
DFSClient can Compress the data when transmitting it over the network, Data Nodes can forward the same compressed data to other Data Nodes in pipeline and as well as it can decompress that data and write on to their local disks.

In Read Scenario:
Data Node can compress the data when transmitting it over the network. DFSClient can decompress it and write on to the local stream.

Issue Links

• relates to: HDDS-7350 Ozone Transparent Data Compression Support
• relates to: HDFS-2115 Transparent compression in HDFS