Description
Printing log data on Kafka brokers using kafka.tools.DumpLogSegments:
--deep-iteration should show a superset of fields in each message, as compared to without this parameter, however some fields are missing. Impact: users need to execute both commands to get the full set of fields.
kafka-run-class kafka.tools.DumpLogSegments \ --print-data-log \ --files 00000000000000000000.log Dumping 00000000000000000000.log Starting offset: 0 baseOffset: 0 lastOffset: 35 baseSequence: -1 lastSequence: -1 producerId: -1 producerEpoch: -1 partitionLeaderEpoch: 0 isTransactional: false position: 0 CreateTime: 1509987569448 isvalid: true size: 3985 magic: 2 compresscodec: NONE crc: 4227905507
kafka-run-class kafka.tools.DumpLogSegments \ --print-data-log \ --files 00000000000000000000.log \ --deep-iteration Dumping 00000000000000000000.log Starting offset: 0 offset: 0 position: 0 CreateTime: 1509987569420 isvalid: true keysize: -1 valuesize: 100 magic: 2 compresscodec: NONE producerId: -1 sequence: -1 isTransactional: false headerKeys: [] payload: SSXVNJHPDQDXVCRASTVYBCWVMGNYKRXVZXKGXTSPSJDGYLUEGQFLAQLOCFLJBEPOWFNSOMYARHAOPUFOJHHDXEHXJBHW
Notice, for example, that partitionLeaderEpoch and crc are missing. Print these and all missing fields.