Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • spark-branch
    • spark
    • None

    Description

      In latest jenkins report(https://builds.apache.org/job/Pig-spark/292/#showFailuresLink), it shows that following unit tests fail:
      org.apache.pig.builtin.TestOrcStoragePushdown.testColumnPruning
      org.apache.pig.builtin.TestOrcStoragePushdown.testPredicatePushdownBigDecimal
      org.apache.pig.builtin.TestOrcStoragePushdown.testPredicatePushdownTimestamp
      org.apache.pig.builtin.TestOrcStoragePushdown.testPredicatePushdownChar
      org.apache.pig.builtin.TestOrcStoragePushdown.testPredicatePushdownByteShort
      org.apache.pig.builtin.TestOrcStoragePushdown.testPredicatePushdownFloatDouble
      org.apache.pig.builtin.TestOrcStoragePushdown.testPredicatePushdownIntLongString
      org.apache.pig.builtin.TestOrcStoragePushdown.testPredicatePushdownBoolean
      org.apache.pig.builtin.TestOrcStoragePushdown.testPredicatePushdownVarchar

      Attachments

        1. PIG-4776.patch
          2 kB
          liyunzhang

        Issue Links

          Activity

            kellyzly liyunzhang added a comment -

            After PIG-4616_1.patch, the unit tests about TestOrcStoragePushdown pass.

            kellyzly liyunzhang added a comment - After PIG-4616 _1.patch, the unit tests about TestOrcStoragePushdown pass.
            kellyzly liyunzhang added a comment -

            TestOrcStoragePushdown is blocked by PIG-4788.
            We modify original code about PigSplit in PIG-4788. After discussion, we decide to disable some unit tests before the spark branch is merged to master to avoid some unstableness. After branch is merged to master successfully, we will reimport following unit tests:
            1. unit tests about TestOrcStoragePushdown
            2. TestPigRunner#testGetHadoopCounters

            xuefuz,PIG-4776's patch is to disable above unit tests.

            kellyzly liyunzhang added a comment - TestOrcStoragePushdown is blocked by PIG-4788 . We modify original code about PigSplit in PIG-4788 . After discussion, we decide to disable some unit tests before the spark branch is merged to master to avoid some unstableness. After branch is merged to master successfully, we will reimport following unit tests: 1. unit tests about TestOrcStoragePushdown 2. TestPigRunner#testGetHadoopCounters xuefuz , PIG-4776 's patch is to disable above unit tests.
            xuefuz Xuefu Zhang added a comment -

            +1

            xuefuz Xuefu Zhang added a comment - +1
            xuefuz Xuefu Zhang added a comment -

            The patch is committed to Spark branch. Thanks, Liyun!

            xuefuz Xuefu Zhang added a comment - The patch is committed to Spark branch. Thanks, Liyun!

            People

              kellyzly liyunzhang
              kellyzly liyunzhang
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: