Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-11010

Fixes and enhancements addressing UDTs' api and several usability concerns

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Epic
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • 1.5.0, 1.5.1
    • None
    • SQL
    • UserDefinedType enhancements

    Description

      Catalyst SQL types allow for UserDefinedTypes, but do not allow for easy extension of 3rd party types or extensions to built-in types like DecimalType or StringType (private classes).

      Additionally, the API can infer much more of what's needed from the type parameter than it currently does.

      Attachments

        Issue Links

        incorporates

        New Feature - A new feature of the product, which has yet to be developed. SPARK-7768 Make user-defined type (UDT) API public

        • Critical - Crashes, loss of data, severe memory leak.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. SPARK-11003 Allowing UserDefinedTypes to extend primatives

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved
        relates to

        Improvement - An improvement or enhancement to an existing feature or task. SPARK-10855 Add a JDBC dialect for Apache Derby

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved
         
        		 SPARK-11003 Allowing UserDefinedTypes to extend primatives Improvement Resolved Unassigned
        Actions
         
        		 SPARK-11011 UserDefinedType serialization should be strongly typed Improvement Resolved Jakob Odersky
        Actions

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            blue666man John Muller
            Votes:
            6 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 168h
                168h
                Remaining:
                Remaining Estimate - 168h
                168h
                Logged:
                Time Spent - Not Specified
                Not Specified

                Slack

                  Issue deployment