Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-13852

[R] Handle Dataset schema metadata in ExecPlan

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      See https://github.com/apache/arrow/pull/10992#issuecomment-910598194. Scanner would preserve the schema metadata but ExecPlan does not, and that makes sense in the general case. But this may result in unexpected behavior in R where we keep R attributes in the schema metadata.

      We could probably determine in ExecPlan$Build which fields in the resulting Table are just carried forward from the underlying Dataset and pull in metadata for them to the result.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            npr Neal Richardson
            npr Neal Richardson
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 1h
                1h

                Issue deployment