[CONNECTORS-285] JobManager getStatus() command always performs slow queries, even when they may not be needed

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: ManifoldCF 0.3
• Fix Version/s: ManifoldCF 0.4
• Component/s: Framework crawler agent
• Assignee: Karl Wright
• Reporter: Karl Wright
• Created: 04/Nov/11 14:06
• Updated: 06/Nov/11 19:28
• Resolved: 06/Nov/11 19:28

Description

The JobManager.getStatus() method, and the associated API operation, always obtain the counts of documents processed or in progress. These queries are slow and don't scale because they require sequential scan of the jobqueue. Sometimes all that is needed is just the status of the job. We should have a way of getting that that is performant.