Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6181

Examining log messages with {{--deep-iteration}} should show superset of fields

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 0.11.0.0
    • 2.8.0
    • core

    Description

      Printing log data on Kafka brokers using kafka.tools.DumpLogSegments:
      --deep-iteration should show a superset of fields in each message, as compared to without this parameter, however some fields are missing. Impact: users need to execute both commands to get the full set of fields.

      kafka-run-class kafka.tools.DumpLogSegments \
      --print-data-log \
      --files 00000000000000000000.log
      Dumping 00000000000000000000.log
      Starting offset: 0
      baseOffset: 0 lastOffset: 35 baseSequence: -1 lastSequence: -1 producerId: -1 producerEpoch: -1 partitionLeaderEpoch: 0 isTransactional: false position: 0 CreateTime: 1509987569448 isvalid: true size: 3985 magic: 2 compresscodec: NONE crc: 4227905507
      
      kafka-run-class kafka.tools.DumpLogSegments \
      --print-data-log \
      --files 00000000000000000000.log \
      --deep-iteration
      Dumping 00000000000000000000.log
      Starting offset: 0
      offset: 0 position: 0 CreateTime: 1509987569420 isvalid: true keysize: -1 valuesize: 100
      magic: 2 compresscodec: NONE producerId: -1 sequence: -1 isTransactional: false headerKeys: [] payload: SSXVNJHPDQDXVCRASTVYBCWVMGNYKRXVZXKGXTSPSJDGYLUEGQFLAQLOCFLJBEPOWFNSOMYARHAOPUFOJHHDXEHXJBHW
      

      Notice, for example, that partitionLeaderEpoch and crc are missing. Print these and all missing fields.

      Attachments

        Activity

          People

            iprithv Prithvi
            yevabyzek Yeva Byzek
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: