Uploaded image for project: 'Daffodil'
  1. Daffodil
  2. DAFFODIL-1830

PCAP - 50m.pcap and 100m.pcap do not parse on 2.0.0-rc3

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 2.0.0
    • 2.0.0
    • General
    • None
    • Performance test platform

    Description

      When attempting to run the pcap performance tests found that the 50m.pcap and 100m.pcap test files did not successfully parse. Executed the daffodil parse command separately for each file and got the following results.

      50m.pcap Command with -I null: ()$ daffodil/daffodil-cli/target/universal/stage/bin/daffodil parse -I null -s /home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd /home/dfdl/ngf-dfdl/daffodil-perf/src/test/resources/edu/illinois/ncsa/daffodil/pcap/50m.pcap Message: [warning] Left over data. Consumed 12432 bit(s) with 419426128 bit(s) remaining. Command with -I xml: ()$ daffodil/daffodil-cli/target/universal/stage/bin/daffodil parse -I xml -s /home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd /home/dfdl/ngf-dfdl/daffodil-perf/src/test/resources/edu/illinois/ncsa/daffodil/pcap/50m.pcap Results: <pcap:PCAP xmlns:pcap="urn:pcap:2.4"> <PCAPHeader> ���� <MagicNumber>D4C3B2A1</MagicNumber> ���� <Version> �������� <Major>2</Major> �������� <Minor>4</Minor> ���� </Version> ���� <Zone>0</Zone> ���� <SigFigs>0</SigFigs> ���� <SnapLen>65535</SnapLen> ���� <Network>1</Network> </PCAPHeader> <Packet> ���� <PacketHeader> �������� <Seconds>1367244575</Seconds> �������� <USeconds>191642</USeconds> �������� <InclLen>1514</InclLen> �������� <OrigLen>1514</OrigLen> ���� </PacketHeader> ���� <pcap:LinkLayer> �������� <pcap:Ethernet> ������������ <MACDest>3C4A92729886</MACDest> ������������ <MACSrc>001B2134662C</MACSrc> ������������ <Ethertype>2048</Ethertype> ������������ <pcap:NetworkLayer> ���������������� <pcap:IPv4> �������������������� <IPv4Header> ������������������������ <Version>4</Version> ������������������������ <IHL>5</IHL> ������������������������ <DSCP>0</DSCP> ������������������������ <ECN>0</ECN> ������������������������ <Length>1500</Length> ������������������������ <Identification>36974</Identification> ������������������������ <Flags>2</Flags> ������������������������ <FragmentOffset>0</FragmentOffset> ������������������������ <TTL>49</TTL> ������������������������ <Protocol>6</Protocol> ������������������������ <Checksum>20238</Checksum> ������������������������ <IPSrc>146.137.96.7</IPSrc> ������������������������ <IPDest>192.168.177.102</IPDest> �������������������� </IPv4Header> �������������������� <Protocol>6</Protocol> �������������������� <pcap:TransportLayer> ������������������������ <pcap:TCP> ���������������������������� <TCPHeader> ������������������������ ����������<PortSRC>80</PortSRC> �������������������������������� <PortDest>37199</PortDest> �������������������������������� <Seq>802941038</Seq> �������������������������������� <Ack>71825065</Ack> �������������������������������� <DataOffset>8</DataOffset> �������������������������������� <Reserved>0</Reserved> �������������������������������� <Flags>16</Flags> �������������������������������� <WindowSize>54</WindowSize> �������������������������������� <Checksum>40234</Checksum> �������������������������������� <Urgent>0</Urgent> �������������������������������� <Options>0101080A314391951321EA44</Options> ���������������������������� </TCPHeader> ���������������������������� <Data>68C263E237A3DB9073CC9809FF2E3DFFB1C5A686E28FCDA362C25F5615AF4E0D7DD623CF008103C51DF23C88CF155B66AC29B15D65F4BE96D075B441736CBB415B6C2787117ED7AB3F430C86E9177848E6B1070D18B3CDC48E7318E18FC961ECA4398897F076D21CCC4B583B316026B713139E8976129726E9A4F8501AD1666C716E2A06BF669B89DB22F110CC3643B6719D26985E2137EC436D71FB0C3FFD67E34CDC88980B39BC2D6EDCC0131F6FF8697C8A316F7CA6618741ED768107FB5C5BBCCC8BE25B50042FB49FB5C5779BDAF70A78EC5B6DF1C3467B8245B4637F6A4B4837B5978AF69156D47DA6F6ADB2BD1BF53DA676C917F64AB6448B613389696EEDBD025B625ED033719DAFC475065F898174D52E7594D8666ADF21F07F857539B1D79837718F681F85FD240E9ADA4745FBD13AC4648BD13E2D55B4630F6B9B966B6A97FC1E3B84BAD324B7168397692D6E415B249A4DEDD33AA4CC695DE836743DCD74C615B5BD8AFB94B01FC3A7A6ED33E11956B92F986044BB292E5952F8332F9B252D78BDB6A41973591097AAE282DE5912302521ED026745483BF7530B48569382E3159DFF84EC23E45EC0E21672F8761DEA2DFA5EC966D9A29FA9DA2C5BF5B37A9B65BB7E766AB374EB67AD36CB2EFDF99ACDB2573F17B259F64BFF2598F1C8F1DF3A874A98F8DF3C49FC6F0E8EFFD63C1107ACA0CD2A6CC6B6183E685D27DB7D280153BDCD04B3DD54DF69AAEFD1E1B14F37C6C6B61B30D1F1466C9F3A60C4F0980E2356C70C18312A66CCC0139D69F866ACB07F5B5E1AD998E1CBD3C6A45FF0186BE08F36F9754CBC116FAD03069EE86E51CFEFA475C4A039C66DB4C75498D6944E53AC5827FDB48DE283A1C7F81403267AC0A02DBA59C8E166F241295BEB41CAAF0C78EB2143BFD671E1CB36D8A86D4ED8F72E0063ACB3B65463AC4DC6071B60EC2DC27E6C6E2AFA3B6CC06BBCD7616B09DEC372F80E941DB2BE1345C628DB08B3253191EB26053FBFB625E5CAF6E0F75E6C494E4143928FF01A7E94D4663C1793E70FE2CC2147DF83D8945CC3D792DA8DBDA16D67D5C47375CEAFAD44DF7783564326495B0C79266D57C3C69324FB049CF24C3EA9CB38777A20DAD4AE86D290D4457C4E82674FD07991E9EC45D1E5603AF3B1251D32CE7CA6348B3839655BB0CCA76C0BA521660FC68E19BCB314813369CFE4E7184CFA0E2B43A908730ED0613A43C6BCAC2E320CC54CD61C1986E221DB6A7A7FCC784F0CF4847DB7CDDC6E633D91F1D39AC8FA0D9B678391E1696D65A3FA3B6690854143D750A88FD0B3B72ED339CF2379B23D45E8AB2A8CBEA6C787D53BC618744E4F0FAB53EB23A6F7301F6931CDDB2160A6DBA998F0AC8D7C1E4BF1707AD57FF7EC37F8CC647AE8FB0FC01DACEBE9B4A78B337D94972862FEF4EE49DA4DF9C6F441E3AC633AE5A8E1E04D6792776C0B8F7346BC71063223250CCD6B839E7DD86698F2901979466C9951A6187567643C94BBCE680EA24DCFA9667418FA9AB1DD84335E7FEF42E401E2BD0BDB8CAE2AED1DB3E0F65E714EC2C7EE8CAC774E4F5FD858A49DF7729DCED82BF8B5C28F66C8F3C61943CCFA9FE9665E8CF7A2FFD36E92ED90496E2332F662CF3863D40CAF2AAD534D769E20FC7AC678C8793EA761664A68FBCC4C2AC65C33EDC6BA36B3A42AECBA39B3C2583767AE5315FB045F9B095B9DD916AAD3193B0D799E680B3EFB9AB92D147EE64498AE88307CBD9BB927321ED2CBCC7D1161F8FA38F3A05C3B10C7668E8AFA2388C9C9CC9055B26AC82A392D7C8E91AC1AB24ACE318D2D348D2D9D646CA149CE6EBBBE3625AFFDDF79DE64E409C94E2DAF0E9673B2FBFF1A7E9EE325B7193E9BDC113E774AEE12F5E43E9441B116248F04E745C97DE1F3BD594CC6997494B562EC2C77F03A322BDD8845B34C795DF248C4E75C5CFEB3DA429FC189773EEDF2399D6157B3B69BEA3B4CF51EA3AEE3477DE17EF4F5EAEFC9DB66EDF9BF3717C970D63EFD79A86DD660C4F746F8D9C5AC8321F460DC049C63FA7B</Data> ������������������������ </pcap:TCP> �������������������� </pcap:TransportLayer> ���������������� </pcap:IPv4> ������������ </pcap:NetworkLayer> �������� </pcap:Ethernet> ���� </pcap:LinkLayer> </Packet> </pcap:PCAP> [warning] Left over data. Consumed 12432 bit(s) with 419426128 bit(s) remaining. 100m.pcap Command: ()$ daffodil/daffodil-cli/target/universal/stage/bin/daffodil parse -I xml -s /home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd /home/dfdl/ngf-dfdl/daffodil-perf/src/test/resources/edu/illinois/ncsa/daffodil/pcap/100m.pcap Error message (same for -I null or -I xml): [error] Parse Error: Failed to populate Packet[1]. Expected 1 item(s). Cause: Parse Error: All alternatives failed. Reason(s): List(Parse Error: Alternative failed. Reason(s): List(Parse Error: Assertion failed. Ethertype is not IPv4 Schema context: sequence Location line 179 column 8 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100, Parse Error: Alternative failed. Reason(s): List(Parse Error: Assertion failed. Ethertype is not IPv6 Schema context: sequence Location line 287 column 8 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd, Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100. Schema context: Packet Location line 29 column 10 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 104858829 [error] Parse Error: All alternatives failed. Reason(s): List(Parse Error: Alternative failed. Reason(s): List(Parse Error: Assertion failed. Ethertype is not IPv4 Schema context: sequence Location line 179 column 8 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100, Parse Error: Alternative failed. Reason(s): List(Parse Error: Assertion failed. Ethertype is not IPv6 Schema context: sequence Location line 287 column 8 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd, Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100

      Attachments

        Activity

          People

            dfthompson Dave Thompson
            dfthompson Dave Thompson
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: