Maven Surefire
  1. Maven Surefire
  2. SUREFIRE-561

after running test, when tests fail, it's hard to the find the failure reason

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.4.3
    • Fix Version/s: 2.13
    • Component/s: Maven Surefire Plugin
    • Labels:
      None

      Description

      Maven & surefire has been here for a while but still I'm missing this feature. When my tests fail, I'd like to know exact failure reason.

      1. Surefire summary does not show the stack trace / line number / assertion. Browsing results files in target dir is frustrating & time consuming.
      2. It is impossible to use surefire-report plugin in fully automated way. If I plug report-only goal to phase test, this goal is not executed when phase test fails

      Current workaround in my project is that every maven submodule has a handy batch file with 'mvn surefire-report:report-only'.

      One of the ways of implementing it is adding stacktrace/assertion information in test summary.

      What do you guys think about this idea?

        Issue Links

          Activity

          Szczepan created issue -
          Hide
          Benjamin Bentmann added a comment -

          1. Surefire summary does not show the stack trace / line number / assertion. Browsing results files in target dir is frustrating & time consuming.

          And you already tried setting the plugin's parameter useFile to false?

          Show
          Benjamin Bentmann added a comment - 1. Surefire summary does not show the stack trace / line number / assertion. Browsing results files in target dir is frustrating & time consuming. And you already tried setting the plugin's parameter useFile to false?
          Hide
          Szczepan added a comment -

          No I haven't - it didn't occur me at all that this option can be any helpful. Thanks for the hint!

          Anyway, I will see how useful it is and get back.

          Show
          Szczepan added a comment - No I haven't - it didn't occur me at all that this option can be any helpful. Thanks for the hint! Anyway, I will see how useful it is and get back.
          james strachan made changes -
          Field Original Value New Value
          Link This issue relates to SUREFIRE-631 [ SUREFIRE-631 ]
          Hide
          james strachan added a comment -

          I think this issue is mostly resolved now - though it would be nice to be able to turn off useFile from the command line like this related issue

          Show
          james strachan added a comment - I think this issue is mostly resolved now - though it would be nice to be able to turn off useFile from the command line like this related issue
          Kristian Rosenvold made changes -
          Component/s Maven Surefire Plugin [ 12561 ]
          Hide
          Alexander Klimetschek added a comment -

          For working with the file reports, have a look at SUREFIRE-701 - it provides a showSuccess=false option that simply omits successful reports. Together with disableXmlReport=true to get rid of the xml files in target/surefire-reports, very useful when you develop & only look for the failed test reports.

          Show
          Alexander Klimetschek added a comment - For working with the file reports, have a look at SUREFIRE-701 - it provides a showSuccess=false option that simply omits successful reports. Together with disableXmlReport=true to get rid of the xml files in target/surefire-reports, very useful when you develop & only look for the failed test reports.
          Kristian Rosenvold made changes -
          Link This issue relates to SUREFIRE-726 [ SUREFIRE-726 ]
          Hide
          Kristian Rosenvold added a comment -

          Fixed with greatly improved summary display

          Show
          Kristian Rosenvold added a comment - Fixed with greatly improved summary display
          Kristian Rosenvold made changes -
          Assignee Kristian Rosenvold [ krosenvold ]
          Resolution Fixed [ 1 ]
          Fix Version/s 2.13 [ 18833 ]
          Status Open [ 1 ] Closed [ 6 ]
          Mark Thomas made changes -
          Project Import Sun Apr 05 13:23:32 UTC 2015 [ 1428240212200 ]
          Mark Thomas made changes -
          Workflow jira [ 12727810 ] Default workflow, editable Closed status [ 12758941 ]
          Mark Thomas made changes -
          Project Import Mon Apr 06 01:36:33 UTC 2015 [ 1428284193036 ]
          Mark Thomas made changes -
          Workflow jira [ 12965796 ] Default workflow, editable Closed status [ 13003422 ]
          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Closed Closed
          1232d 4h 39m 1 Kristian Rosenvold 11/Dec/12 14:45

            People

            • Assignee:
              Kristian Rosenvold
              Reporter:
              Szczepan
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development