Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8610

Log rotation can fail gerrit-verify-dryrun/ubuntu-16.04-from-scratch jobs

    XMLWordPrintableJSON

    Details

    • Epic Color:
      ghx-label-6

      Description

      It seems that otherwise successful runs of ubuntu-16.04-from-scratch can fail at the end when copying log files in the end. If the impalads are still running, they can rotate a logfile while cp tries to copy it, which results in output like this (affected job):

      00:24:28 + cp -r -L /home/ubuntu/Impala/logs /home/ubuntu/Impala/logs_static
      00:24:37 cp: cannot stat '/home/ubuntu/Impala/logs/cluster/impalad.ip-172-31-19-200.ubuntu.log.WARNING.20190601-072315.102026': No such file or directory
      00:24:37 cp: cannot stat '/home/ubuntu/Impala/logs/cluster/impalad.ip-172-31-19-200.ubuntu.log.WARNING.20190601-072304.100810': No such file or directory
      00:24:37 cp: cannot stat '/home/ubuntu/Impala/logs/cluster/impalad.ip-172-31-19-200.ubuntu.log.WARNING.20190601-072315.102023': No such file or directory
      

      Note that the script is currently configured in Jenkins to run in a shell with -e and that a successful run contains additional lines after the cp command:

      04:16:18 + cp -r -L /home/ubuntu/Impala/logs /home/ubuntu/Impala/logs_static
      04:16:21 + rm -f /tmp/git-err-ksiZp.log
      

      As a fix we should kill all daemons before copying the files.

        Attachments

          Activity

            People

            • Assignee:
              lv Lars Volker
              Reporter:
              lv Lars Volker
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: