Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6181

Examining log messages with {{--deep-iteration}} should show superset of fields

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 0.11.0.0
    • Fix Version/s: None
    • Component/s: core
    • Labels:

      Description

      Printing log data on Kafka brokers using kafka.tools.DumpLogSegments:
      --deep-iteration should show a superset of fields in each message, as compared to without this parameter, however some fields are missing. Impact: users need to execute both commands to get the full set of fields.

      kafka-run-class kafka.tools.DumpLogSegments \
      --print-data-log \
      --files 00000000000000000000.log
      Dumping 00000000000000000000.log
      Starting offset: 0
      baseOffset: 0 lastOffset: 35 baseSequence: -1 lastSequence: -1 producerId: -1 producerEpoch: -1 partitionLeaderEpoch: 0 isTransactional: false position: 0 CreateTime: 1509987569448 isvalid: true size: 3985 magic: 2 compresscodec: NONE crc: 4227905507
      
      kafka-run-class kafka.tools.DumpLogSegments \
      --print-data-log \
      --files 00000000000000000000.log \
      --deep-iteration
      Dumping 00000000000000000000.log
      Starting offset: 0
      offset: 0 position: 0 CreateTime: 1509987569420 isvalid: true keysize: -1 valuesize: 100
      magic: 2 compresscodec: NONE producerId: -1 sequence: -1 isTransactional: false headerKeys: [] payload: SSXVNJHPDQDXVCRASTVYBCWVMGNYKRXVZXKGXTSPSJDGYLUEGQFLAQLOCFLJBEPOWFNSOMYARHAOPUFOJHHDXEHXJBHW
      

      Notice, for example, that partitionLeaderEpoch and crc are missing. Print these and all missing fields.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                yevabyzek Yeva Byzek
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated: