Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-954

Improve logging for Samza

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.11.0
    • Fix Version/s: 0.11.0
    • Component/s: None
    • Labels:
      None

      Description

      Often Samza jobs keep running for days (and in our case months). Often log messages generated by the job get rolled over. A lot of information that is critical for debugging a job (like the jmx server port, URL, job model for the current container, configuration that was passed to the container) is often printed when the job starts. However, since logs get rolled over (by Yarn/ by sys-administrators) when they exceed a certain size, this information is lost.

      This JIRA is to add a separate samza-container-$containerID-startup.log file with each container. This will have information useful for debugging the job.

        Attachments

        1. SAMZA-954_1.patch
          7 kB
          Jake Maes
        2. SAMZA-954_2.patch
          7 kB
          Jake Maes

          Activity

            People

            • Assignee:
              jmakes Jake Maes
              Reporter:
              jagadish1989@gmail.com Jagadish
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: