Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-40087

Support multiple Column drop in R

Rank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.3.0
    • 3.4.0
    • R
    • None
    • Support for SparkR to drop multiple "Column"

    Description

      This is a followup on SPARK-39895. The PR previously attempted to adjust implementation for R as well to match signatures but that part was removed and we only focused on getting python implementation to behave correctly.

      Change supports following operations:

      df <- select(read.json(jsonPath), "name", "age")

      df$age2 <- df$age

      df1 <- drop(df, df$age, df$name)
      expect_equal(columns(df1), c("age2"))

      df1 <- drop(df, df$age, column("random"))
      expect_equal(columns(df1), c("name", "age2"))

      df1 <- drop(df, df$age, df$name)
      expect_equal(columns(df1), c("age2"))

       

       

       

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            santosh.pingale Santosh Pingale
            santosh.pingale Santosh Pingale
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment