Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-541

[JS] Implement JavaScript-compatible implementation

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.8.0
    • JavaScript
    • None

    Description

      I would really like to see an implementation of Arrow that is compatible with NodeJS and modern web browsers. This would enable streaming columnar data to the browser without an intermediate conversion to JSON – I could imagine web-based data visualization systems would benefit substantially from this functionality.

      Because Google's Flatbuffers library has first-class JS support, this should be achievable. Carlos Scheidegger created a prototype implementation of the Feather file format (basically: mini-Arrow) last year: https://github.com/wesm/feather/tree/master/js

      This JIRA can be an umbrella issue for the JS implementation. As soon as we find interested contributors to work on this, we can create JIRAs and attach them to this issue until we reach a certain level of maturity.

      Without starting a bike shed discussion, I humbly request that the implementation be done in TypeScript https://www.typescriptlang.org/

      Attachments

        Issue Links

          contains

          Bug - A problem which impairs or prevents the functions of the product. ARROW-613 [JS] Implement random-access file format

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. ARROW-940 [JS] Generate multiple sets of artifacts

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. ARROW-949 [JS] Use flatc to generate TypeScript

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. ARROW-872 [JS] Read streaming format

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. ARROW-874 [JS] Read dictionary-encoded vectors

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. ARROW-873 [JS] Implement fixed width list type

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. ARROW-1032 [JS] Support custom_metadata

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-987 [JS] Implement JSON writer for Integration tests

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-988 [JS] Add entry to Travis CI matrix

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. ARROW-629 [JS] Add unit test suite

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. ARROW-869 [JS] Rename directory to js/

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Task - A task that needs to be done. ARROW-951 [JS] Fix generated API documentation

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Task - A task that needs to be done. ARROW-870 [JS] Move io operations to arrow.io namespace

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Activity

            People

              paul.e.taylor Paul Taylor
              wesm Wes McKinney
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: