Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-2832

Sqoop2: Precommit: Create log files for individual tests

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.99.7
    • None
    • None

    Description

      I feel that debugging anything in our pre-commit hook is currently mission impossible from several reasons. One of the main ones is that we're generating one single log file that has grown to 1GB in size with all "test related" logs and I'm not even remotely able to find anything there.

      In normal case we would have one log per test class, but as we've refactored our integration tests to run multiple classes inside single Suite, we're no longer have that for free. We have done this change to cut the time it takes to run the integration tests - before we were initializing mini clusters for each class, which is extra ~40 seconds per class, so I don't think that reverting it would be reasonable.

      We should perhaps explore other ways how to get multiple log files.

      Attachments

        1. SQOOP-2832.patch
          9 kB
          Jarek Jarcec Cecho
        2. SQOOP-2832.patch
          9 kB
          Jarek Jarcec Cecho
        3. SQOOP-2832.patch
          6 kB
          Jarek Jarcec Cecho
        4. SQOOP-2832.patch
          5 kB
          Jarek Jarcec Cecho

        Issue Links

          Activity

            People

              jarcec Jarek Jarcec Cecho
              jarcec Jarek Jarcec Cecho
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: