Uploaded image for project: 'Log4j 2'
  1. Log4j 2
  2. LOG4J2-1297

Document "gc-free" configuration and performance

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.5
    • 2.6
    • Documentation
    • None

    Description

      Update the site with a description of which configurations are GC-free (i.e., that don't create temporary objects in steady running state).

      Currently that means

      • Loggers are all asynchronous (Log4jContextSelector is set to org.apache.logging.log4j.core.async.AsyncLoggerContextSelector).
      • The configuration does not contain a <Properties> section.
      • The "steady-state" appenders are either RandomAccessFile or RollingRandomAccessFile Appenders (logging to any other appender will cause temporary objects to be created - including ConsoleAppender).
      • The Layout is a PatternLayout that uses one of the pre-defined date formats, does not have any regular expression replacements, and does not have lookups (TODO: may need to restrict this further).
      • The thread name is cached (this is the default). Running with -DAsyncLogger.ThreadNameStrategy=UNCACHED will create garbage.
      • In user code, when logging a parameterized message, the number of parameters is no more than ... (TBD pending discussion in LOG4J2-1278).
      • In user code, when logging a parameterized message, parameters of primitive type are boxed in a reused StringBuilder (Log4j provides a utility to make this relatively painless).

      Even with the above restrictions, Log4j may occasionally create garbage:

      • Initially StringBuilders are presized to 128 characters. They may grow for larger messages (contributing to garbage in Old Gen). If the StringBuilder grows beyond 512 characters it is trimmed back to 512 characters to prevent memory leaks from excessively long messages. (TODO: the resizing algorithm is size = value.length * 2 + 2, so a better cutoff value is 518.)
      • Messages containing "${" will be converted to a String and StrSubstitutor will be used to replace occurences of variables with their matching values. Multiple temporary objects are created during this process.

      Furthermore, we need to explain that some of this functionality depends on ThreadLocals and so is disabled by default in web applications to prevent memory leaks. The page should also explain how to manually switch off the use of ThreadLocals.

      Finally, the page should show a performance test comparison similar to the performance section on the Async Loggers page. I'm thinking a comparison between Logback, Log4j-1, Log4j-2.0, Log4j-2.6 "classic" and Log4j-2.6 "gc-free" would be ideal.

      Attachments

        1. ResponseTimeAllAsyncGarbageFree100k-800k.png
          39 kB
          Remko Popma
        2. ResponseTimeSyncGarbageFree.png
          35 kB
          Remko Popma
        3. ResponseTimeSyncClassic.png
          43 kB
          Remko Popma
        4. ResponseTimeAllAsyncGarbageFree2.png
          41 kB
          Remko Popma
        5. ResponseTimeAllAsyncGarbageFree.png
          39 kB
          Remko Popma
        6. ResponseTimeAllAsyncClassic5k-800k.png
          60 kB
          Remko Popma
        7. garbage-free2.6-SyncThroughputLinux.png
          68 kB
          Remko Popma
        8. LatencyHistogram.png
          54 kB
          Remko Popma
        9. log4j-2.6-FlightRecording.png
          49 kB
          Remko Popma
        10. log4j-2.5-FlightRecording.png
          67 kB
          Remko Popma

        Activity

          People

            rpopma Remko Popma
            rpopma Remko Popma
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: