[DAFFODIL-1886] TLOG: Delimited parsing with occursCountKind="implicit" with separators is not handling missing optional elements correctly

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 2.4.0
• Component/s: Compatibility, Front End
• Labels: ForInteroperabilityTest
• Assignee: Dave Thompson
• Reporter: Josh Adams
• Created: 31/Jan/18 20:32
• Updated: 20/May/21 12:34
• Resolved: 23/May/19 17:24

Description

This bug currently prevents the IBM4690-TLOG schema project from working.

Example schema:

<tdml:defineSchema name="s15">
  <dfdl:format ref="ex:daffodilTest1" lengthKind="delimited" encoding="ISO-8859-1" occursCountKind="implicit" textNumberCheckPolicy="strict" textNumberPadCharacter="0" textNumberJustification="right"
lengthUnits="bytes" separatorSuppressionPolicy="trailingEmpty" separatorPosition="prefix"/>

  <xs:element name="testSeq" dfdl:lengthKind="delimited">
    <xs:complexType>
      <xs:sequence dfdl:initiatedContent="no" dfdl:separatorPosition="infix"
        dfdl:sequenceKind="ordered" dfdl:separator=":">
        <xs:element name="a" type="xs:int"/>
        <xs:element name="b" type="xs:int" minOccurs="0"/>
        <xs:element name="c" type="xs:int" minOccurs="0"/>
      </xs:sequence>
    </xs:complexType>
  </xs:element>

</tdml:defineSchema>

This schema should be able to parse the following scenarios:

1:2:3 -> a=1, b=2, c=3

1:2: -> a=1, b=2

1::3 -> a=1, c=3

1:: -> a=1

Currently scenarios 1,2 and 4 work as expected, but scenario 3 ends up parsing as just a=1 and b and c are just skipped.