[TIKA-2641] Unit test for consistency between tabular/columnar formats

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.18, 2.0.0
• Component/s: parser
• Assignee: Unassigned
• Reporter: Nick Burch
• Created: 03/May/18 20:41
• Updated: 12/Apr/21 12:59

Description

We now have a number of parsers which deal with file formats which are either wholey or optionally "table-based" formats with consistency in the data types held in a given column. This includes multi-table formats like sqlite, single-table formats like sas7bdat, and anything-goes-table formats like csv or xlsx

We should firstly try to create a simple-ish, small but rich file for each of these formats, similar to what we do for archive formats with the test-documents archives. Then, we should add unit tests that verified that, as much as formats permit, you get basically the same XHTML out for the "same" input. Oh, and fix up any obvious inconsistencies...