Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-8282

[C++/Python][Dataset] Support schema evolution for integer columns

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 4.0.0
    • C++

    Description

      When reading in a dataset where the schema specifies that column X is of type int64 but the partition actually contains the data stored in that columns as int32, an upcast should be done.

      Attachments

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-8065 [C++][Dataset] Untangle Dataset, Fragment and ScanOptions

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-11003 [C++][Dataset] Schema evolution in Dataset scanning

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              uwe Uwe Korn
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: