Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-2702

Fetcher: suppress stack for frequent exceptions

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 1.15
    • Fix Version/s: 1.16
    • Component/s: fetcher
    • Labels:
      None

      Description

      Fetcher logs the entire Java stack when a fetch fails with an Exception. To reduce the size of the fetcher logs, frequent exceptions with an obvious reason should be logged without stack, at least, for the default log level (INFO).

      Frequent and obvious exceptions are:

      • java.net.UnknownHostException
      • java.net.SocketTimeoutException
      • java.net.ConnectException
      • javax.net.ssl.SSLHandshakeException

      Class name and message should be sufficient by default. For debugging the fetch can be retried with a more verbose log level.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                wastl-nagel Sebastian Nagel
                Reporter:
                wastl-nagel Sebastian Nagel
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: