Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.1.0
    • SQL
    • None

    Description

      Based on the discussions in the parent ticket (SPARK-22231), add a new dropFields method to the Column class.
      This method should allow users to drop a column nested inside a StructType Column (with similar semantics to the existing drop method on Dataset).
      It should also be able to handle deeply nested columns through the same API.
      This is similar to the withField method that was recently added in SPARK-31317 and likely we can re-use some of that "infrastructure."

      The public-facing method signature should be something along the following lines:

      def dropFields(fieldNames: String*): Column
      

      Attachments

        Activity

          People

            fqaiser94 fqaiser94
            fqaiser94 fqaiser94
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: