[KYLIN-1434] Kylin Job Monitor API: /kylin/api/jobs is too slow in large kylin deployment

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Resolved
• Affects Version/s: v1.3.0, v1.4.0, v1.5.0
• Fix Version/s: v1.5.1
• Assignee: Hao Chen
• Reporter: Hao Chen
• Created: 23/Feb/16 07:28
• Updated: 13/Apr/16 02:04
• Resolved: 20/Mar/16 12:28

Description

The API request for Job Monitor page like:

/kylin/api/jobs?limit=15&offset=15

takes more than 11 seconds for fetching only 15 row records (25.1 KB), which is too slow.

Issue Links

• is related to: KYLIN-1509 Pagination with [start rowkey+limit] is much more efficient than using [offset+limit]
• relates to: KYLIN-1504 Use NavigableSet to store rowkey and use prefix filter to check resource path prefix instead String comparison on tomcat side
• relates to: KYLIN-1505 Combine guava filters with Predicates.and
• relates to: KYLIN-1506 Refactor resource interface for timeseries-based data like jobs to much better performance