[ARROW-7283] [Integration] Ensure dictionary IPC implementations match spec clarifications

• Type: Improvement
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Component/s: Integration
• External issue URL: https://github.com/apache/arrow/issues/23572
• Assignee: Unassigned
• Reporter: Micah Kornfield
• Created: 02/Dec/19 01:17
• Updated: 11/Jan/23 07:52

Description

Parent tracking issue to ensure clarification in PR: https://github.com/apache/arrow/pull/5585#pullrequestreview-324979419 are correctly implemented.  

 

Specifically:

1.  dictionary replacement in streams.

2.  Not requiring dictionaries be present at the beginning of the stream for all null columns.

3.  Dictionary replacement isn't supported in the file format.

 

Some implementations might already have some or all of these.  This specific Jira covers adding integration tests (children tasks cover language specific implementations).

Issue Links

• duplicates: ARROW-5767 [Format] Permit dictionary replacements in IPC protocol

Sub-Tasks

• [Java] ensure java implementation meets clarified dictionary spec: Resolved
• [C++] ensure C++ implementation meets clarified dictionary spec: Resolved
• [Go] Ensure go implementation implements clarified dictionary spec: Resolved
• [JS] Ensure Javascript implementation implements clarified dictionary spec: Open