[ARROW-1693] [JS] Error reading dictionary-encoded integration test files

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.8.0
• Component/s: JavaScript
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/17701
• Assignee: Paul Taylor
• Reporter: Brian Hulette
• Created: 20/Oct/17 14:22
• Updated: 11/Jan/23 07:16
• Resolved: 20/Nov/17 14:23

Description

The JS implementation crashes when reading the dictionary test case from the integration tests.

To replicate, first generate the test files with java and cpp impls:

$ cd ${ARROW_HOME}/integration/
$ python -c 'from integration_test import generate_dictionary_case; generate_dictionary_case().write("dictionary.json")'
$ ../cpp/debug/debug/json-integration-test --integration --json=dictionary.json --arrow=dictionary-cpp.arrow --mode=JSON_TO_ARROW
$ java -cp ../java/tools/target/arrow-tools-0.8.0-SNAPSHOT-jar-with-dependencies.jar org.apache.arrow.tools.Integration -c JSON_TO_ARROW -a dictionary-java.arrow -j dictionary.json

Attempt to read the files with the JS impl:

$ cd ${ARROW_HOME}/js/
$ ./bin/arrow2csv.js -s dict1_0 -f ../integration/dictionary-{java,cpp}.arrow

Both files result in an error for me on a8f51858:
TypeError: Cannot read property 'buffer' of undefined

Issue Links

• blocks: ARROW-1501 [JS] JavaScript integration tests
• incorporates: ARROW-1698 [JS] File reader attempts to load the same dictionary batch more than once
• is related to: ARROW-1785 [Format/C++/Java] Remove VectorLayout metadata from Flatbuffers metadata
• links to: GitHub Pull Request #1294