[ASTERIXDB-1078] Refactor testing framework to compare expected results as ADMs

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: *DB - AsterixDB, TEST - Test Framework
• Assignee: Ian Maxon
• Reporter: Ildar Absalyamov
• Created: 19/Aug/15 16:51
• Updated: 14/Sep/15 20:38

Description

The current version of testing framework uses string comparison to ensure that the test results are equivalent to the expected.
To ignore some query-time specific information in the result (such as Timestamp) it just uses String.split and compares the result prefix with the expected value.
Due to the fact that Timestamp field is the last field in closed part of the record, and specifics of the ADM record serialization (open fields are always written in the end), the result comparator completely ignores the values of the open fields.
Testing framework should compare results in ADM format, respecting semantics such as:
1) Ignoring order of the values in bags
2) Ignoring value of Timestamp field
3) Applying numeric conversions (0.1 vs 1e-1)
4) etc

Issue Links

• relates to: ASTERIXDB-999 Tests use string comparison for results, even where not appropriate