Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-3896

[MATLAB] Decouple MATLAB-Arrow conversion logic from Feather file specific logic

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • MATLAB
    • None

    Description

      Currently, the logic for converting between a MATLAB mxArray and various Arrow data structures (arrow::Table, arrow::Array, etc.) is tightly coupled and fairly tangled up with the logic specific to handling Feather files. It would be helpful to factor out these conversions into a more generic "mlarrow" conversion layer component so that it can be reused in the future for use cases other than Feather support. Furthermore, this would be helpful to enforce a cleaner separation of concerns.

      It would be nice to start off with this refactoring work up front before adding support for more datatypes to the MATLAB featherread/featherwrite functions, so that we can start off with a clean base upon which to expand moving forward.

      Attachments

        Activity

          People

            Unassigned Unassigned
            kgurney Kevin Gurney
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - 72h
                72h
                Remaining:
                Remaining Estimate - 72h
                72h
                Logged:
                Time Spent - Not Specified
                Not Specified