Steps to reproduce:
Suppose distcp MR job is copying the file /tmp/web_returns_merged/data-m-002 and
we append some more data to this file using command
hadoop fs -appendToFile xaa /tmp/web_returns_merged/data-m-002
the job fails with exception
Mismatch in length of source:hdfs://mycluster0/tmp/web_returns_merged/data-m-002 and target.
Attached the logs.
- links to