Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-1766

CubeTupleConverter.translateResult() is slow due to date conversion

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • v1.5.3
    • None
    • None

    Description

      As attached, profiling shows that current filling tuple is slow especially about dates. The norm form "yyyy-mm-dd" is parsed into a Date, then converted into # since epic day. This is slow because of Java's slow SimpleDateFormat.

      An idea is to refine the norm form of date/time to be the time millis. This will save a lot of str <--> date conversions. However the change impacts dictionary, lookup snapshot, and maybe data ingestion. Also need to think about backward compatibility.

      Attachments

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            liyang.gmt8@gmail.com liyang
            liyang.gmt8@gmail.com liyang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment