Details
Description
What is the expect result when the crawler fails to move a file due to disk constraints?
In my experience, and I will attach some files for your reference, the file that failed to transfer remains in the file manager's catalogue partially transferred. At this point the crawler has exited with a failure. Remnants of the ingested file remain in the archive.
I would expect the file to be removed from the catalogue on failure since ingestion was reported as a failure and file moved to failed directory.
please advise.