[CONNECTORS-1532] Moving a file outside of the job's Paths is not the same as deleting it - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: ManifoldCF 2.10
Fix Version/s: ManifoldCF 2.12
Component/s: Documentum connector
Labels:
None
Environment:

Manifold 2.10 patched for #1512, #1517

Description

If I have a MF job which is connecting a specific folder, F, in Documentum to a File System output then:

1. deleting files in Documentum shows them as zero size in the file system
2. moving files out of F does not remove them or zero them in the file system

Note that moving a file from another folder (which the job is not looking at) to F has the same effect as adding it to F by e.g. importing it in DM or POSTing it to DM via the REST interface.

Intuitively, I expect that moving a file out of the "view" of the Documentum connector would have the same effect on the File System as deleting it. (My model here is of MF synchronising content between the Paths (DM) and the Output Path (File System) that I have specified in the job.)

Starting point, I have run the MF job to fetch a bunch of files from a folder - call it F - in DM (i.e. I have configured Paths in the job to be F). This is what 'ls -l' on the file system looks like:

-rw-r--r--. 1 root i2e  12541 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7c0
-rw-r--r--. 1 root i2e     26 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7be
-rw-r--r--. 1 root i2e  85772 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7c7
-rw-r--r--. 1 root i2e   8790 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7c2
-rw-r--r--. 1 root i2e 101888 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7c3
-rw-r--r--. 1 root i2e  32783 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7c4
-rw-r--r--. 1 root i2e  23040 Sep 19 07:22 drl?versionLabel=CURRENT&objectId=090000018000f7c1
-rw-r--r--. 1 root i2e  26112 Sep 19 07:22 drl?versionLabel=CURRENT&objectId=090000018000f7bf

In DM, I delete one of the files in F and it shows as zero size, and the modification date has changed:

-rw-r--r--. 1 root i2e  12541 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7c0
-rw-r--r--. 1 root i2e     26 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7be
-rw-r--r--. 1 root i2e   8790 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7c2
-rw-r--r--. 1 root i2e 101888 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7c3
-rw-r--r--. 1 root i2e  32783 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7c4
-rw-r--r--. 1 root i2e  23040 Sep 19 07:22 drl?versionLabel=CURRENT&objectId=090000018000f7c1
-rw-r--r--. 1 root i2e  26112 Sep 19 07:22 drl?versionLabel=CURRENT&objectId=090000018000f7bf
-rw-r--r--. 1 root i2e      0 Sep 19 07:23 drl?versionLabel=CURRENT&objectId=090000018000f7c7

In DM, I move a file from F to another folder. (Right click, add to clipboard, go to new folder, Edit> Move here).

The file shows as modified (07:25), but is still apparently in F (i.e. in the Path my MF job is looking at):

-rw-r--r--. 1 root i2e  12541 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7c0
-rw-r--r--. 1 root i2e     26 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7be
-rw-r--r--. 1 root i2e   8790 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7c2
-rw-r--r--. 1 root i2e 101888 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7c3
-rw-r--r--. 1 root i2e  23040 Sep 19 07:22 drl?versionLabel=CURRENT&objectId=090000018000f7c1
-rw-r--r--. 1 root i2e  26112 Sep 19 07:22 drl?versionLabel=CURRENT&objectId=090000018000f7bf
-rw-r--r--. 1 root i2e      0 Sep 19 07:23 drl?versionLabel=CURRENT&objectId=090000018000f7c7
-rw-r--r--. 1 root i2e  32783 Sep 19 07:25 drl?versionLabel=CURRENT&objectId=090000018000f7c4

In DM, I move a file from another folder to F and it shows up with the timestamp of the move (07:28):

-rw-r--r--. 1 root i2e  12541 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7c0
-rw-r--r--. 1 root i2e     26 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7be
-rw-r--r--. 1 root i2e   8790 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7c2
-rw-r--r--. 1 root i2e 101888 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7c3
-rw-r--r--. 1 root i2e  23040 Sep 19 07:22 drl?versionLabel=CURRENT&objectId=090000018000f7c1
-rw-r--r--. 1 root i2e  26112 Sep 19 07:22 drl?versionLabel=CURRENT&objectId=090000018000f7bf
-rw-r--r--. 1 root i2e      0 Sep 19 07:23 drl?versionLabel=CURRENT&objectId=090000018000f7c7
-rw-r--r--. 1 root i2e  32783 Sep 19 07:25 drl?versionLabel=CURRENT&objectId=090000018000f7c4
-rw-r--r--. 1 root i2e 191513 Sep 19 07:28 drl?versionLabel=CURRENT&objectId=09000001800045b9

But if I immediately move it out in DM then, again, the timestamp (07:30) alters but the file apparently remains:

-rw-r--r--. 1 root i2e  12541 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7c0
-rw-r--r--. 1 root i2e     26 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7be
-rw-r--r--. 1 root i2e   8790 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7c2
-rw-r--r--. 1 root i2e 101888 Sep 19 07:21 drl?versionLabel=CURRENT&objectId=090000018000f7c3
-rw-r--r--. 1 root i2e  23040 Sep 19 07:22 drl?versionLabel=CURRENT&objectId=090000018000f7c1
-rw-r--r--. 1 root i2e  26112 Sep 19 07:22 drl?versionLabel=CURRENT&objectId=090000018000f7bf
-rw-r--r--. 1 root i2e      0 Sep 19 07:23 drl?versionLabel=CURRENT&objectId=090000018000f7c7
-rw-r--r--. 1 root i2e  32783 Sep 19 07:25 drl?versionLabel=CURRENT&objectId=090000018000f7c4
-rw-r--r--. 1 root i2e 191513 Sep 19 07:30 drl?versionLabel=CURRENT&objectId=09000001800045b9

In DM, I now delete all visible content in F. The files that were moved out of F, and are not visible in F in DM, remain on the file system:

-rw-r--r--. 1 root i2e      0 Sep 19 07:23 drl?versionLabel=CURRENT&objectId=090000018000f7c7
-rw-r--r--. 1 root i2e  32783 Sep 19 07:25 drl?versionLabel=CURRENT&objectId=090000018000f7c4
-rw-r--r--. 1 root i2e 191513 Sep 19 07:30 drl?versionLabel=CURRENT&objectId=09000001800045b9
-rw-r--r--. 1 root i2e      0 Sep 19 07:31 drl?versionLabel=CURRENT&objectId=090000018000f7c2
-rw-r--r--. 1 root i2e      0 Sep 19 07:31 drl?versionLabel=CURRENT&objectId=090000018000f7be
-rw-r--r--. 1 root i2e      0 Sep 19 07:31 drl?versionLabel=CURRENT&objectId=090000018000f7c0
-rw-r--r--. 1 root i2e      0 Sep 19 07:31 drl?versionLabel=CURRENT&objectId=090000018000f7c1
-rw-r--r--. 1 root i2e      0 Sep 19 07:31 drl?versionLabel=CURRENT&objectId=090000018000f7bf
-rw-r--r--. 1 root i2e      0 Sep 19 07:31 drl?versionLabel=CURRENT&objectId=090000018000f7c3

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

2018-09-19_1758.png
19/Sep/18 16:59
37 kB
James Thomas
CONNECTORS-1532.patch
22/Sep/18 04:59
3 kB
Karl Wright
DCTM.java
30/Sep/18 13:58
168 kB
Karl Wright
logging_patch.diff
20/Sep/18 13:08
3 kB
Karl Wright

Activity

People

Assignee:: Karl Wright

Reporter:: James Thomas

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 19/Sep/18 09:00

Updated:: 01/Oct/18 07:33

Resolved:: 30/Sep/18 14:00