Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-9221

Support IntervalType in Range Frame

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.3.0
    • SQL
    • None

    Description

      Support the IntervalType in window range frames, as mentioned in the conclusion of the databricks blog post on window functions.

      This actualy requires us to support Literals instead of Integer constants in Range Frames. The following things will have to be modified:

      • org.apache.spark.sql.hive.HiveQl
      • org.apache.spark.sql.catalyst.expressions.SpecifiedWindowFrame
      • org.apache.spark.sql.execution.Window
      • org.apache.spark.sql.expressions.Window

      Attachments

        Issue Links

          is blocked by

          Sub-task - The sub-task of the issue SPARK-8064 Upgrade Hive to 1.2

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-8943 CalendarIntervalType for time intervals

          • Major - Major loss of function.
          • Resolved
          is related to

          Umbrella - An overarching type made of sub-tasks SPARK-25841 Redesign window function rangeBetween API

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #18814 [Github] Pull Request #18814 (jiangxb1987)

          Activity

            People

              jiangxb1987 Xingbo Jiang
              hvanhovell Herman van Hövell
              Votes:
              2 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: