Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-4001

Allow user-specified time format using real-time

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v3.0.0-alpha2
    • Component/s: Real-time Streaming
    • Labels:
      None

      Description

      • I found that real-time only supports millisecond timestamp, does not support second timestamp and  Date type like '2019-01-01 11:11:11'.
      • I add a LongTimeParser and a DateTimeParser and page configuration 
      • You can configure tsParser, tsPattern on the page that creates the streaming table.
      • for date :
        { "timestamp":"2019-04-29 11:11:11","gmv":1.1 }
        
        You can specify
        
        tsParser=org.apache.kylin.stream.source.kafka.DateTimeParser
        tsPattern=yyyy-MM-dd HH:mm:ss

         

      • for second :
        { "timestamp":"1556618887","gmv":1.1 }
        
        You can specify
        
        tsParser=org.apache.kylin.stream.source.kafka.LongTimeParser
        tsPattern=S

         

      • for millisecond :
        { "timestamp":"1556618887000","gmv":1.1 }
        
        You can specify
        
        tsParser=org.apache.kylin.stream.source.kafka.LongTimeParser
        tsPattern=MS
        

         
         

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                ning.guo ning guo
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: