[KYLIN-712] some enhancement after code review

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: v1.4.0
• Assignee: Unassigned
• Reporter: Qianhao Zhou
• Due: 24/Apr/15
• Created: 21/Apr/15 10:05
• Updated: 17/Mar/16 07:37
• Resolved: 01/Oct/15 02:52

Description

• In config json, accept multiple zookeeper to tolerate single point of failure
• In config json, partition number can be omitted, read it from zookeeper. Or another option is keep the configure, and validate it against zookeeper at runtime. The latter makes the mapping between partition and sharding clearer.
• Should report the data up-to-date time in some way. On a second thought, I don’t think segment end time is the right place, but some other API.

Sub-Tasks

• accept multiple zookeeper in KafkaConfig: Closed
• read topic partitions from Kafka instead of metadata: Closed
• new api for streaming to report up-to-date time: Closed