Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-3666

Oozie log streaming bug when log timestamps are the same on multiple Oozie servers

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 5.2.1
    • 5.3.0
    • core

    Description

      We have found a bug in the mechanism of the Oozie log streaming.

      Affected code lines: https://github.com/apache/oozie/blob/release-5.2.1/core/src/main/java/org/apache/oozie/service/ZKXLogStreamingService.java#L221L250
      This code is responsible for collating all of the logs from the available Oozie servers.However, in case there is a log message in server "A" with the same timestamp as an other log message in server "B", then according to the current implementation, the logs acquired by using `TimestampedMessageParser` corresponding to server "B" will be overwritten by server "A" 's parser (due to the operation of timestampMap.put(earliestParser.getLastTimestamp(), earliestParser)), therefore causing the log messages from server "B" to be ignored from that point.

      Attachments

        1. OOZIE-3666-003.patch
          12 kB
          János Makai
        2. OOZIE-3666-002.patch
          12 kB
          János Makai
        3. OOZIE-3666-001.patch
          11 kB
          János Makai

        Activity

          People

            jmakai János Makai
            jmakai János Makai
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: