Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.5.0
    • Fix Version/s: 0.6.0
    • Component/s: Tests
    • Labels:
      None

      Description

      TestHiveSmokeBulk fails with 17 failures and 1 error when smoking Hive 0.9

        Issue Links

          Activity

          Hide
          Konstantin Boudnik added a comment -

          The following test cases are failing:

          Failed tests: testHiveBulk[bucketizedhiveinputformat](org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script
          bucketizedhiveinputformat expected:<0> but was:<1>
          testHiveBulk[load_dyn_part14](org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script load_dyn_part14 expecte
          d:<0> but was:<1>
          testHiveBulk[union3](org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script union3 expected:<0> but was:<1>
          testHiveBulk[rcfile_columnar](org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script rcfile_columnar expecte
          d:<0> but was:<1>
          testHiveBulk[drop_multi_partitions](org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script drop_multi_partit
          ions expected:<0> but was:<1>
          testHiveBulk[authorization_2](org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script authorization_2 expecte
          d:<0> but was:<147>
          testHiveBulk[uniquejoin](org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script uniquejoin expected:<0> but
          was:<1>
          testHiveBulk[bucketmapjoin5](org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script bucketmapjoin5 expected:
          <0> but was:<1>
          testHiveBulk[stats8](org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script stats8 expected:<0> but was:<1>
          testHiveBulk[join19](org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script join19 expected:<0> but was:<1>
          testHiveBulk[auto_join20](org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script auto_join20 expected:<0> but was:<1>
          testHiveBulk[multi_insert](org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script multi_insert expected:<0> but was:<1>
          testHiveBulk[index_creation](org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script index_creation expected:<0> but was:<1>
          testHiveBulk[groupby_map_ppr_multi_distinct](org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script groupby_map_ppr_multi_distinct expected:<0> but was:<1>
          testHiveBulk[join_filters](org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script join_filters expected:<0> but was:<9>
          testHiveBulk[merge_dynamic_partition](org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script merge_dynamic_partition expected:<0> but was:<1>
          testHiveBulk[basic](org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script basic expected:<0> but was:<1>

          Show
          Konstantin Boudnik added a comment - The following test cases are failing: Failed tests: testHiveBulk [bucketizedhiveinputformat] (org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script bucketizedhiveinputformat expected:<0> but was:<1> testHiveBulk [load_dyn_part14] (org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script load_dyn_part14 expecte d:<0> but was:<1> testHiveBulk [union3] (org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script union3 expected:<0> but was:<1> testHiveBulk [rcfile_columnar] (org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script rcfile_columnar expecte d:<0> but was:<1> testHiveBulk [drop_multi_partitions] (org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script drop_multi_partit ions expected:<0> but was:<1> testHiveBulk [authorization_2] (org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script authorization_2 expecte d:<0> but was:<147> testHiveBulk [uniquejoin] (org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script uniquejoin expected:<0> but was:<1> testHiveBulk [bucketmapjoin5] (org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script bucketmapjoin5 expected: <0> but was:<1> testHiveBulk [stats8] (org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script stats8 expected:<0> but was:<1> testHiveBulk [join19] (org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script join19 expected:<0> but was:<1> testHiveBulk [auto_join20] (org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script auto_join20 expected:<0> but was:<1> testHiveBulk [multi_insert] (org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script multi_insert expected:<0> but was:<1> testHiveBulk [index_creation] (org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script index_creation expected:<0> but was:<1> testHiveBulk [groupby_map_ppr_multi_distinct] (org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script groupby_map_ppr_multi_distinct expected:<0> but was:<1> testHiveBulk [join_filters] (org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script join_filters expected:<0> but was:<9> testHiveBulk [merge_dynamic_partition] (org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script merge_dynamic_partition expected:<0> but was:<1> testHiveBulk [basic] (org.apache.bigtop.itest.hivesmoke.TestHiveSmokeBulk): Got unexpected output from test script basic expected:<0> but was:<1>
          Hide
          Mark Grover added a comment -

          Konstantin Boudnik Thanks for filing this. I am happy to take a look but are these still relevant given that Bigtop 0.6 has Hive 0.10? If so, can you please point me to the Jenkins job that runs these tests so I can try to reproduce? I tried some poking around but wasn't able to find anything relevant on Bigtop Jenkins.

          Show
          Mark Grover added a comment - Konstantin Boudnik Thanks for filing this. I am happy to take a look but are these still relevant given that Bigtop 0.6 has Hive 0.10? If so, can you please point me to the Jenkins job that runs these tests so I can try to reproduce? I tried some poking around but wasn't able to find anything relevant on Bigtop Jenkins.
          Hide
          Konstantin Boudnik added a comment -

          Mark, I don't think that a mere presence of Hive 0.10 has magically fixed BigTop tests.
          I don't have a Jenkins job as I was running everything on my VM cluster, however, there should be latest BT trunk builds against Hadoop 2.0.4 in the usual place.

          Show
          Konstantin Boudnik added a comment - Mark, I don't think that a mere presence of Hive 0.10 has magically fixed BigTop tests. I don't have a Jenkins job as I was running everything on my VM cluster, however, there should be latest BT trunk builds against Hadoop 2.0.4 in the usual place.
          Hide
          Mark Grover added a comment -

          Thanks, Cos. Let me take a look.

          Show
          Mark Grover added a comment - Thanks, Cos. Let me take a look.
          Hide
          Mark Grover added a comment -

          I took a look at this and it seems like compiler plans have changed as hive updates and we haven't updated our test outputs with those compiler plans. I think, long term, it makes sense for us to leverage the upstream Hive test infrastructure and use it to run the tests on our fully distributed cluster. That way, we can directly leverage upstream tests and output assertions. Let me take a look and see how much work it is and if it can be done real quick in Bigtop 0.6 time frame. If not, I would be inclined to either do the cosmetic task of updating the test outputs or disabling these tests in Bigtop 0.6 scope and pursue the task of leveraging upstream tests and framework post Bigtop 0.6.

          Show
          Mark Grover added a comment - I took a look at this and it seems like compiler plans have changed as hive updates and we haven't updated our test outputs with those compiler plans. I think, long term, it makes sense for us to leverage the upstream Hive test infrastructure and use it to run the tests on our fully distributed cluster. That way, we can directly leverage upstream tests and output assertions. Let me take a look and see how much work it is and if it can be done real quick in Bigtop 0.6 time frame. If not, I would be inclined to either do the cosmetic task of updating the test outputs or disabling these tests in Bigtop 0.6 scope and pursue the task of leveraging upstream tests and framework post Bigtop 0.6.
          Hide
          Roman Shaposhnik added a comment -

          Mark, thanks for looking into this. Lets make the final determination on Mon on how to proceed and update the tests one way or another.

          Show
          Roman Shaposhnik added a comment - Mark, thanks for looking into this. Lets make the final determination on Mon on how to proceed and update the tests one way or another.
          Hide
          Mark Grover added a comment -

          Roman/Cos, I spent a few hours searching docs and poking around Hive code. I wasn't able to find any option to run unit tests in a fully-distributed mode. I will send an email to the Hive dev community in case I missed something but the only options I found were to run tests against a local mode cluster or a miniMR cluster. Unless I hear otherwise from the Hive community, I would urge us to move forward with fixing or ignoring the test failures discussed in this JIRA for Bigtop 0.6 and work on leveraging hive unit tests directly after such support is added in Hive. I have created HIVE-4362 for the same.

          Please let me know what you think.

          Show
          Mark Grover added a comment - Roman/Cos, I spent a few hours searching docs and poking around Hive code. I wasn't able to find any option to run unit tests in a fully-distributed mode. I will send an email to the Hive dev community in case I missed something but the only options I found were to run tests against a local mode cluster or a miniMR cluster. Unless I hear otherwise from the Hive community, I would urge us to move forward with fixing or ignoring the test failures discussed in this JIRA for Bigtop 0.6 and work on leveraging hive unit tests directly after such support is added in Hive. I have created HIVE-4362 for the same. Please let me know what you think.
          Hide
          Roman Shaposhnik added a comment -

          Mark, in general I agree that HIVE-4362 is the right way to go about it long term. That said, for Bigtop 0.6.0 we desperately need some level of Hive coverage. I don't think we can go out without testing Hive in fully distributed mode at least somewhat. Would you be able to update as many tests as you see practically useful in time for Bigtop 0.6.0?

          Show
          Roman Shaposhnik added a comment - Mark, in general I agree that HIVE-4362 is the right way to go about it long term. That said, for Bigtop 0.6.0 we desperately need some level of Hive coverage. I don't think we can go out without testing Hive in fully distributed mode at least somewhat. Would you be able to update as many tests as you see practically useful in time for Bigtop 0.6.0?
          Hide
          Mark Grover added a comment -

          Fair enough. I will get some tests working

          Show
          Mark Grover added a comment - Fair enough. I will get some tests working
          Hide
          Mark Grover added a comment -

          Updated test output.

          Removed two tests: authorization_2, stats8

          Show
          Mark Grover added a comment - Updated test output. Removed two tests: authorization_2, stats8
          Hide
          Konstantin Boudnik added a comment -

          Mark, all the tests are passing now?

          Show
          Konstantin Boudnik added a comment - Mark, all the tests are passing now?
          Hide
          Mark Grover added a comment -

          Cos, I tried them on a my own 3 node cluster and they pass. We are using filters to filter out cluster specific information when comparing the actual test output from expected test output. It's very possible that those filters may need to be tweaked in case I missed something from the test output that is cluster specific but I thought otherwise but I wouldn't really know until this gets run on Bigtop's integration test clusters.

          Thoughts?

          Show
          Mark Grover added a comment - Cos, I tried them on a my own 3 node cluster and they pass. We are using filters to filter out cluster specific information when comparing the actual test output from expected test output. It's very possible that those filters may need to be tweaked in case I missed something from the test output that is cluster specific but I thought otherwise but I wouldn't really know until this gets run on Bigtop's integration test clusters. Thoughts?
          Hide
          Konstantin Boudnik added a comment -

          My dev VM server went into maintenance this night and I don't want to run the tests on the laptop as it's going to be painfully slow. I looked through the changes and they seem ok. So, I'd say

          +1 on the patch.

          Let's commit it and see if anything comes up in the official trunk testing. We can follow up with the filter tweaking separately. Any objections from the others?

          Show
          Konstantin Boudnik added a comment - My dev VM server went into maintenance this night and I don't want to run the tests on the laptop as it's going to be painfully slow. I looked through the changes and they seem ok. So, I'd say +1 on the patch. Let's commit it and see if anything comes up in the official trunk testing. We can follow up with the filter tweaking separately. Any objections from the others?
          Hide
          Mark Grover added a comment -

          Sounds like a plan to me.
          And I put the diff up for review at https://reviews.apache.org/r/10758/
          in case it helps.

          Show
          Mark Grover added a comment - Sounds like a plan to me. And I put the diff up for review at https://reviews.apache.org/r/10758/ in case it helps.
          Hide
          Konstantin Boudnik added a comment -

          I have committed it to master - let's how it pans out in the official test run. Thanks Mark.

          Show
          Konstantin Boudnik added a comment - I have committed it to master - let's how it pans out in the official test run. Thanks Mark.

            People

            • Assignee:
              Mark Grover
              Reporter:
              Konstantin Boudnik
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development