[HDDS-4413] Container replication should fail in case of import failure

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.1.0
• Component/s: Ozone Datanode
• Labels: pull-request-available
• Assignee: Ayush Saxena
• Reporter: Wei-Chiu Chuang
• Created: 30/Oct/20 16:46
• Updated: 13/Nov/20 10:24
• Resolved: 04/Nov/20 03:57

Description

See the following log. There was an EOF exception when importing the container, however, the log message next line says successful.

2020-10-30 08:11:02,985 INFO org.apache.hadoop.ozone.container.replication.DownloadAndImportReplicator: Starting replication of container 740890 from [0ffe3494-8498-48b8-8877-e7986a151e
a4{ip: 10.12.1.72, host: rhel02.ozone.cisco.local, networkLocation: /default, certSerialId: null}, ab448e94-d2fd-48b0-bd57-8d4e88cbd893{ip: 10.12.1.83, host: rhel13.ozone.cisco.local, n
etworkLocation: /default, certSerialId: null}]
2020-10-30 08:11:08,548 INFO org.apache.hadoop.ozone.container.replication.GrpcReplicationClient: Container 740890 is downloaded to /tmp/container-copy/container-740890.tar.gz
2020-10-30 08:11:08,548 INFO org.apache.hadoop.ozone.container.replication.DownloadAndImportReplicator: Container 740890 is downloaded, starting to import.
2020-10-30 08:11:08,563 ERROR org.apache.hadoop.ozone.container.replication.DownloadAndImportReplicator: Can't import the downloaded container data id=740890
java.io.IOException: unexpected EOF with 7680 bytes unread. Occured at byte: 7447040
        at org.apache.commons.compress.archivers.tar.TarArchiveInputStream.read(TarArchiveInputStream.java:490)
        at org.apache.commons.compress.archivers.tar.TarArchiveInputStream.skip(TarArchiveInputStream.java:182)
        at org.apache.commons.compress.archivers.tar.TarArchiveInputStream.getNextTarEntry(TarArchiveInputStream.java:220)
        at org.apache.commons.compress.archivers.tar.TarArchiveInputStream.getNextEntry(TarArchiveInputStream.java:435)
        at org.apache.hadoop.ozone.container.keyvalue.TarContainerPacker.unpackContainerDescriptor(TarContainerPacker.java:182)
        at org.apache.hadoop.ozone.container.replication.DownloadAndImportReplicator.importContainer(DownloadAndImportReplicator.java:74)
        at org.apache.hadoop.ozone.container.replication.DownloadAndImportReplicator.replicate(DownloadAndImportReplicator.java:121)
        at org.apache.hadoop.ozone.container.replication.ReplicationSupervisor$TaskRunner.run(ReplicationSupervisor.java:129)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2020-10-30 08:11:08,564 INFO org.apache.hadoop.ozone.container.replication.DownloadAndImportReplicator: Container 740890 is replicated successfully
2020-10-30 08:11:08,564 INFO org.apache.hadoop.ozone.container.replication.ReplicationSupervisor: Container 740890 is replicated.

Issue Links

• links to: Github PR #1537
• links to: GitHub Pull Request #1537