Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.1.0
    • Component/s: SQL
    • Labels:
      None

      Description

      Based on the discussions in the parent ticket (SPARK-22231), add a new dropFields method to the Column class.
      This method should allow users to drop a column nested inside a StructType Column (with similar semantics to the existing drop method on Dataset).
      It should also be able to handle deeply nested columns through the same API.
      This is similar to the withField method that was recently added in SPARK-31317 and likely we can re-use some of that "infrastructure."

      The public-facing method signature should be something along the following lines:

      def dropFields(fieldNames: String*): Column
      

        Attachments

          Activity

            People

            • Assignee:
              fqaiser94 fqaiser94
              Reporter:
              fqaiser94 fqaiser94
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: