Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4768

Improve logging of table loading for supportability.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: Impala 2.8.0
    • Fix Version/s: Impala 2.9.0
    • Component/s: Catalog
    • Labels:

      Description

      Recent changes like 694d72ea9bd1543e2bf1b0a2edf2af213f89a35b and IMPALA-4172 changed the behavior of logging, in particular, during table loading. The new logging is drastically reduced, but unfortunately, insufficient for any meaningful debugging of issues with table loading. We should restore/improve important log messages without increasing the default log volume too much.

        Activity

        Hide
        alex.behm Alexander Behm added a comment -

        commit 3b7a179197bccdebf9c8492477f0cf88c6df0e18
        Author: Alex Behm <alex.behm@cloudera.com>
        Date: Thu Jan 12 16:54:31 2017 -0800

        IMPALA-4768: Improve logging of table loading.

        • Improves the logging for several important events,
          in particular, during table loading.
        • Uses LOG.info() for such messages to clarify their
          intent.

        The goal is to improve supportability without having
        to turn on trace debugging which can generate a
        significant log volume.

        Change-Id: I8de96d0cb6d09b2272b1925d42cb059367fe7196
        Reviewed-on: http://gerrit.cloudera.org:8080/5709
        Reviewed-by: Alex Behm <alex.behm@cloudera.com>
        Tested-by: Impala Public Jenkins

        Show
        alex.behm Alexander Behm added a comment - commit 3b7a179197bccdebf9c8492477f0cf88c6df0e18 Author: Alex Behm <alex.behm@cloudera.com> Date: Thu Jan 12 16:54:31 2017 -0800 IMPALA-4768 : Improve logging of table loading. Improves the logging for several important events, in particular, during table loading. Uses LOG.info() for such messages to clarify their intent. The goal is to improve supportability without having to turn on trace debugging which can generate a significant log volume. Change-Id: I8de96d0cb6d09b2272b1925d42cb059367fe7196 Reviewed-on: http://gerrit.cloudera.org:8080/5709 Reviewed-by: Alex Behm <alex.behm@cloudera.com> Tested-by: Impala Public Jenkins
        Hide
        jbapple Jim Apple added a comment -

        This is a bulk comment on all issues with Fix Version 2.8.0 that were resolved on or after 2016-12-09.

        2.8.0 was branched on December 9, with only two changes to master cherry-picked to the 2.8.0 release branch after that:

        https://github.com/apache/incubator-impala/commits/2.8.0

        Issues fixed after December 9 might not be fixed in 2.8.0. If you are the one who marked this issue Resolved, can you check to see if the patch is in 2.8.0 by using the link above? If the patch is not in 2.8.0, can you change the Fix Version to 2.9.0?

        Thank you!

        Show
        jbapple Jim Apple added a comment - This is a bulk comment on all issues with Fix Version 2.8.0 that were resolved on or after 2016-12-09. 2.8.0 was branched on December 9, with only two changes to master cherry-picked to the 2.8.0 release branch after that: https://github.com/apache/incubator-impala/commits/2.8.0 Issues fixed after December 9 might not be fixed in 2.8.0. If you are the one who marked this issue Resolved, can you check to see if the patch is in 2.8.0 by using the link above? If the patch is not in 2.8.0, can you change the Fix Version to 2.9.0? Thank you!

          People

          • Assignee:
            alex.behm Alexander Behm
            Reporter:
            alex.behm Alexander Behm
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development