Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14281 Dynamometer Phase 2
  3. HDFS-14819

[Dynamometer] Cannot parse audit logs with ‘=‘ in unexpected places when starting a workload.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.3.0
    • None
    • None

    Description

      When trying to launch a workload job, if any of the given audit logs’ values contain `=` aside from at the ends of the log’s keys (such as `ugi`, `src`), the audit log will not be parsed and an exception is thrown.

      For example, this audit log will result in exception, as it contains `=` in the `src` value (“/projects/date=0822”).
       

      2019-08-22 01:00:00,186 INFO FSNamesystem.audit: allowed=true   ugi=feed (auth:aaaaa) ip=/119.472.323.333      cmd=getfileinfo	src=/projects/date=0822 dst=null
              perm=null       proto=rpc
      

      If the second `=` in `src=/projects/date=0822` is removed, it works fine.

      Attachments

        1. HDFS-14819.003.patch
          4 kB
          Soya Miyoshi
        2. HDFS-14819.002.patch
          4 kB
          Soya Miyoshi
        3. HDFS-14819.001.patch
          4 kB
          Soya Miyoshi

        Activity

          People

            soyamiyoshi Soya Miyoshi
            soyamiyoshi Soya Miyoshi
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: