[KYLIN-4001] Allow user-specified time format using real-time

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: v3.0.0-alpha2
• Component/s: Real-time Streaming
• Assignee: Unassigned
• Reporter: ning guo
• Created: 12/May/19 02:07
• Updated: 21/Jan/20 07:43
• Resolved: 12/Jun/19 03:15

Description

• I found that real-time only supports millisecond timestamp, does not support second timestamp and  Date type like '2019-01-01 11:11:11'.
• I add a LongTimeParser and a DateTimeParser and page configuration 
• You can configure tsParser, tsPattern on the page that creates the streaming table.
• for date :

  { "timestamp":"2019-04-29 11:11:11","gmv":1.1 }
  
  You can specify
  
  tsParser=org.apache.kylin.stream.source.kafka.DateTimeParser
  tsPattern=yyyy-MM-dd HH:mm:ss

   

• for second :

  { "timestamp":"1556618887","gmv":1.1 }
  
  You can specify
  
  tsParser=org.apache.kylin.stream.source.kafka.LongTimeParser
  tsPattern=S

   

• for millisecond :

  { "timestamp":"1556618887000","gmv":1.1 }
  
  You can specify
  
  tsParser=org.apache.kylin.stream.source.kafka.LongTimeParser
  tsPattern=MS
  

   
   

Issue Links

• links to: GitHub Pull Request #624