Uploaded image for project: 'Ranger'
  1. Ranger
  2. RANGER-1105

Ranger should provide configuration to do hdfs audit file roll over at absolute time

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.7.0
    • Fix Version/s: 0.7.0
    • Component/s: None
    • Labels:
      None

      Description

      Ranger should provide configuration to have do hdfs audit file roll over at absolute time. Currently parameter "xasecure.audit.destination.hdfs.file.rollover.sec" is used for rollover and the files are closed on relative time using this value from the start of the component. Instead we provide "xasecure.audit.destination.hdfs.file.rollover.period" which take time period with suffix -"m" - minutes, "h" - hours , "d" - days , "w" - weeks, "M" - month, "y" -years.
      eg.
      if xasecure.audit.destination.hdfs.file.rollover.period - 1d - ranger audit file in hdfs would be rolled over at 1 day window i.e file will be closed exactly at 23:59:59 hour for that day and a new file will be opened for 00:00:00 hour. In this way we have file content which is exactly for that time period window in this case 1 day.

      xasecure.audit.destination.hdfs.file.rollover.period - 1d for 1 day rollover period
      xasecure.audit.destination.hdfs.file.rollover.period - 2d for 2 day rollover period
      xasecure.audit.destination.hdfs.file.rollover.period - 10m for every 10 minutes rollover period.
      xasecure.audit.destination.hdfs.file.rollover.period - 1w for every week rollover window
      xasecure.audit.destination.hdfs.file.rollover.period -1M for one month rollover window.

      if this is param is not specified, it uses "xasecure.audit.destination.hdfs.file.rollover.sec" to compute the absolute window.
      By default this is 1day meaning if both the parameters are not specified the rollover window would be 1day.

        Attachments

        1. RANGER-1105.patch
          13 kB
          Ramesh Mani

          Activity

            People

            • Assignee:
              rmani Ramesh Mani
              Reporter:
              rmani Ramesh Mani
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: