Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3185

RM Web UI does not sort the columns in some cases.

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: mrv2
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      While running lots of jobs on a MRv2 cluster the RM web UI shows this error on loading the RM web UI:

      "DataTables warning (table id = 'apps'): Added data (size 8) does not match known number of columns (9)"

      After ignoring the error, the column sorting on Web UI stops working.

      1. MAPREDUCE-3185.patch
        1 kB
        Jonathan Eagles

        Issue Links

          Activity

          Hide
          Robert Joseph Evans added a comment -

          If there are lots of apps in the apps table it will try to fetch some of them using AJAX. There is probably a mismatch between the JSON returned from the call, and what the data table needs. Looks like we added in a column some where and forgot to update the JSON.

          Show
          Robert Joseph Evans added a comment - If there are lots of apps in the apps table it will try to fetch some of them using AJAX. There is probably a mismatch between the JSON returned from the call, and what the data table needs. Looks like we added in a column some where and forgot to update the JSON.
          Hide
          Ramya Sunil added a comment -

          I see this issue happening very often. The tables no longer can be sorted and also the next pages cannot be viewed after running a little over 100+ jobs. Raising the priority since the UI becomes completely unusable at this point.

          Show
          Ramya Sunil added a comment - I see this issue happening very often. The tables no longer can be sorted and also the next pages cannot be viewed after running a little over 100+ jobs. Raising the priority since the UI becomes completely unusable at this point.
          Hide
          Jonathan Eagles added a comment -

          The default row limit for switching to JSON vs HTML is 100 rows. You can specify the rowlimit URL param to override the default.

          For Example
          <machine>:<port>/cluster/apps?rowlimit=1

          Show
          Jonathan Eagles added a comment - The default row limit for switching to JSON vs HTML is 100 rows. You can specify the rowlimit URL param to override the default. For Example <machine>:<port>/cluster/apps?rowlimit=1
          Hide
          Jonathan Eagles added a comment -

          Manual testing was performed with ?rowlimit=1 before and after the patch was applied

          Show
          Jonathan Eagles added a comment - Manual testing was performed with ?rowlimit=1 before and after the patch was applied
          Hide
          Mahadev konar added a comment -

          +1 looks good to me. Ill go ahead and commit this.

          Show
          Mahadev konar added a comment - +1 looks good to me. Ill go ahead and commit this.
          Hide
          Jonathan Eagles added a comment -

          Cool. Thanks for taking a look, Mahadev.

          Show
          Jonathan Eagles added a comment - Cool. Thanks for taking a look, Mahadev.
          Hide
          Mahadev konar added a comment -

          Just committed this. Thanks Jonathan!

          Show
          Mahadev konar added a comment - Just committed this. Thanks Jonathan!
          Hide
          Mahadev konar added a comment -

          Ran tests/test-patch on my box, hudson failed on running the test-patch on this patch. Not sure why.

          Show
          Mahadev konar added a comment - Ran tests/test-patch on my box, hudson failed on running the test-patch on this patch. Not sure why.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk-Commit #1185 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1185/)
          MAPREDUCE-3185. RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev)

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190165
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1185 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1185/ ) MAPREDUCE-3185 . RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190165 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-0.23-Commit #93 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/93/)
          MAPREDUCE-3185. RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev) - Merging r1190165 from trunk.

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190166
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Show
          Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #93 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/93/ ) MAPREDUCE-3185 . RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev) - Merging r1190165 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190166 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-0.23-Commit #93 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/93/)
          MAPREDUCE-3185. RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev) - Merging r1190165 from trunk.

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190166
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #93 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/93/ ) MAPREDUCE-3185 . RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev) - Merging r1190165 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190166 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #1262 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1262/)
          MAPREDUCE-3185. RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev)

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190165
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1262 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1262/ ) MAPREDUCE-3185 . RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190165 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-0.23-Commit #93 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/93/)
          MAPREDUCE-3185. RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev) - Merging r1190165 from trunk.

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190166
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #93 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/93/ ) MAPREDUCE-3185 . RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev) - Merging r1190165 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190166 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #1206 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1206/)
          MAPREDUCE-3185. RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev)

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190165
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1206 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1206/ ) MAPREDUCE-3185 . RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190165 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-0.23-Build #53 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/53/)
          MAPREDUCE-3185. RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev) - Merging r1190165 from trunk.

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190166
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #53 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/53/ ) MAPREDUCE-3185 . RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev) - Merging r1190165 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190166 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #877 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/877/)
          MAPREDUCE-3185. RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev)

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190165
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #877 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/877/ ) MAPREDUCE-3185 . RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190165 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-0.23-Build #70 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/70/)
          MAPREDUCE-3185. RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev) - Merging r1190165 from trunk.

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190166
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #70 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/70/ ) MAPREDUCE-3185 . RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev) - Merging r1190165 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190166 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #846 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/846/)
          MAPREDUCE-3185. RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev)

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190165
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #846 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/846/ ) MAPREDUCE-3185 . RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190165 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/AppsList.java
          Hide
          Jonathan Eagles added a comment -

          Thanks Mahadev, Ramya, and Bobby for all the help getting this in.

          Show
          Jonathan Eagles added a comment - Thanks Mahadev, Ramya, and Bobby for all the help getting this in.

            People

            • Assignee:
              Jonathan Eagles
              Reporter:
              Mahadev konar
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development