Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-4589

ML add-ons to SchemaRDD

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete CommentsDelete
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • None
    • None
    • ML, MLlib, SQL
    • None

    Description

      One feedback we received from the Pipeline API (SPARK-3530) is about the boilerplate code in the implementation. We can add more Scala DSL to simplify the code for the operations we need in ML. Those operations could live under spark.ml via implicit, or be added to SchemaRDD directly if they are also useful for general purpose.

      Attachments

        Issue Links

        Is contained by

        New Feature - A new feature of the product, which has yet to be developed. SPARK-2247 Data frame (or Pandas) like API for structured data

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned Assign to me
            mengxr Xiangrui Meng
            Michael Armbrust Michael Armbrust
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment