Uploaded image for project: 'Ranger'
  1. Ranger
  2. RANGER-3961

AuditFileSpool logs out all events that were not audited successfully

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0, 2.4.0
    • 3.0.0
    • Ranger
    • None

    Description

      In AuditFileSpool.java from line 901-905, there is this code:

      } catch (Throwable t) {
         logger.error("Error while sending logs to consumer. provider="
               + queueProvider.getName() + ", consumer="
               + consumerProvider.getName() + ", log=" + lines, t);
      } 

      Here the variable lines holds all the events that are in current batch, that is 1000 by default (~0.5MB of strings). The batch can be configured even higher that makes things worse.

      If there is an issue in audit, a lot of huge strings will be logged out.

      Suggesting to remove lines variable and/or add lines.size() to know how many events were not sent.

      Attachments

        Issue Links

          Activity

            People

              maheshbandal Mahesh Hanumant Bandal
              maheshbandal Mahesh Hanumant Bandal
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: