Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25556 Predicate Pushdown for Nested fields
  3. SPARK-32325

JSON predicate pushdown for nested fields

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsAdd voteVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete CommentsDelete
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.1.0
    • None
    • SQL
    • None

    Description

      SPARK-30648 should support filters pushdown to JSON datasource but it supports only filters that refer to top-level fields. The ticket aims to support nested fields as well. See the needed changes: https://github.com/apache/spark/pull/27366#discussion_r443340603

      Attachments

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned Assign to me
            maxgekk Max Gekk
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:

              Slack

                Issue deployment