Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-11364 [Rust] Umbrella issue for parquet 2.6.0 support
  3. ARROW-11365

[Rust] [Parquet] Implement parsers for v2 of the text schema

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 4.0.0
    • Rust

    Description

      V2 of the writer produces schema like:

          required INT32 fieldname INTEGER(32, true);

      We should support parsing this format, as it maps to logical types.
      I'm unsure of what the implications are for fields that don't have a logical type representation, but have a converted type (e.g. INTERVAL). We can try write a V2 file with parquet-cpp and observe the behaviour.

      Attachments

        Issue Links

          Activity

            People

              nevi_me Neville Dipale
              nevi_me Neville Dipale
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1.5h
                  1.5h