Details

      Description

      Kudu table name is missing from in the summary view

      Operator          #Hosts   Avg Time   Max Time    #Rows  Est. #Rows  Peak Mem  Est. Peak Mem  Detail                    
      ------------------------------------------------------------------------------------------------------------------------
      02:HASH JOIN           8    4s432ms    4s870ms  600.57K     600.04M  13.14 MB        2.00 GB  LEFT SEMI JOIN, BROADCAST 
      |--03:EXCHANGE         8    4.960ms    5.904ms  150.00K          -1         0              0  BROADCAST                 
      |  01:SCAN HDFS        1    7.010ms    7.010ms  150.00K          -1   4.00 MB       32.00 MB  tpch_100_kudu.delete_1    
      00:SCAN KUDU           8  442.010ms  724.523ms  600.64M     600.04M  20.62 MB              0
      

      Incorrect fragment timings reported

        Averaged Fragment F00:(Total: 238.225ms, non-child: 0.000ns, % non-child: 0.00%)
            split sizes:  min: 0, max: 0, avg: 0, stddev: 0
            completion times: min:2562047h47m  max:-9223372036854775808.000ns  mean: -nanns  stddev:0.000ns
            execution rates: min:8589934592.00 GB/sec  max:-9223372036854775808.00 B/sec  mean:-nan B/sec  stddev:0.00 /sec
      
      1. kudu_dml_profile.txt
        56 kB
        Mostafa Mokhtar

        Activity

        Hide
        twmarshall Thomas Tauber-Marshall added a comment -

        commit 49b6af54c8194af34eacd5322dd6e2ea831f27f8
        Author: Thomas Tauber-Marshall <tmarshall@cloudera.com>
        Date: Tue May 9 13:12:38 2017 -0700

        IMPALA-4499: Table name missing from exec summary

        For scan nodes, previously only HDFS tables showed the name
        of the table in the 'Detail' section for the scan node. This
        change adds the table name for all scan node types (Kudu,
        HBase, and DataSource).

        Testing:

        • Added an e2e test in test_observability.

        Change-Id: If4fd13f893aea4e7df8a2474d7136770660e4324
        Reviewed-on: http://gerrit.cloudera.org:8080/6832
        Reviewed-by: Thomas Tauber-Marshall <tmarshall@cloudera.com>
        Reviewed-by: Alex Behm <alex.behm@cloudera.com>
        Tested-by: Impala Public Jenkins

        Show
        twmarshall Thomas Tauber-Marshall added a comment - commit 49b6af54c8194af34eacd5322dd6e2ea831f27f8 Author: Thomas Tauber-Marshall <tmarshall@cloudera.com> Date: Tue May 9 13:12:38 2017 -0700 IMPALA-4499 : Table name missing from exec summary For scan nodes, previously only HDFS tables showed the name of the table in the 'Detail' section for the scan node. This change adds the table name for all scan node types (Kudu, HBase, and DataSource). Testing: Added an e2e test in test_observability. Change-Id: If4fd13f893aea4e7df8a2474d7136770660e4324 Reviewed-on: http://gerrit.cloudera.org:8080/6832 Reviewed-by: Thomas Tauber-Marshall <tmarshall@cloudera.com> Reviewed-by: Alex Behm <alex.behm@cloudera.com> Tested-by: Impala Public Jenkins
        Hide
        mmokhtar Mostafa Mokhtar added a comment -

        No longer an issue.

         Averaged Fragment F00:(Total: 2m48s, non-child: 4.369ms, % non-child: 0.00%)
              split sizes:  min: 0, max: 0, avg: 0, stddev: 0
              completion times: min:2m37s  max:3m  mean: 2m48s  stddev:6s883ms
              execution rates: min:0.00 /sec  max:0.00 /sec  mean:0.00 /sec  stddev:0.00 /sec
        
        Show
        mmokhtar Mostafa Mokhtar added a comment - No longer an issue. Averaged Fragment F00:(Total: 2m48s, non-child: 4.369ms, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:2m37s max:3m mean: 2m48s stddev:6s883ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
        Hide
        twmarshall Thomas Tauber-Marshall added a comment -

        I haven't been able to repro the incorrect timings (the code that generates the timing has changed significantly since this JIRA was filed, so it may no longer be a problem), but I filed a review for the table name part: https://gerrit.cloudera.org/#/c/6832/

        Show
        twmarshall Thomas Tauber-Marshall added a comment - I haven't been able to repro the incorrect timings (the code that generates the timing has changed significantly since this JIRA was filed, so it may no longer be a problem), but I filed a review for the table name part: https://gerrit.cloudera.org/#/c/6832/

          People

          • Assignee:
            twmarshall Thomas Tauber-Marshall
            Reporter:
            mmokhtar Mostafa Mokhtar
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development