Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-310

Publish container logs to a SystemStream

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.7.0
    • 0.9.0
    • container
    • None

    Description

      At the moment, it's a bit awkward to get to a Samza job's logs: assuming you're running on YARN, you have to navigate around the YARN web interface, and you can only see one container's logs at a time.

      Given that Samza is all about streams, it would make sense for the logs generated by Samza jobs to also be sent to a stream. There, they could be indexed with Kibana, consumed by an exception-tracking system, etc.

      Notes:

      • The serde for encoding logs into a suitable wire format should be pluggable. There can be a default implementation that uses JSON, analogous to MetricsSnapshotSerdeFactory for metrics, but organisations that already have a standardised in-house encoding for logs should be able to use it.
      • Should this be at the level of Slf4j or Log4j? Currently the log configuration for YARN jobs uses Log4j, which has the advantage that any frameworks/libraries that use Log4j but not Slf4j appear in the logs. However, Samza itself currently only depends on Slf4j. If we tie this feature to Log4j, it would somewhat defeat the purpose of using Slf4j.
      • Do we need to consider partitioning? Perhaps we can use the container name as partitioning key, so that the ordering of logs from each container is preserved.

      Attachments

        1. SAMZA-310.7.patch
          29 kB
          Yan Fang
        2. SAMZA-310.6.patch
          29 kB
          Yan Fang
        3. SAMZA-310.5.patch
          27 kB
          Yan Fang
        4. SAMZA-310.4.patch
          27 kB
          Yan Fang
        5. SAMZA-310.2.patch
          23 kB
          Yan Fang
        6. SAMZA-310.1.patch
          15 kB
          Yan Fang
        7. SAMZA-310.patch
          20 kB
          Yan Fang

        Issue Links

          Activity

            People

              closeuris Yan Fang
              martinkl Martin Kleppmann
              Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: