Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-713

Missing INET4 in UniformRangePartition

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0, 0.9.0
    • Component/s: Data Shuffle
    • Labels:
      None

      Description

      Since the INET4 type is not handled properly, an error occurs with the following log.

      2014-03-26 18:16:34,978 ERROR querymaster.SubQuery (SubQuery.java:transition(652)) - SubQuery (eb_1395825278930_0001_000002) ERROR:
      java.lang.UnsupportedOperationException: type: INET4
       is not supported yet
              at org.apache.tajo.engine.planner.UniformRangePartition.increment(UniformRangePartition.java:411)
              at org.apache.tajo.engine.planner.UniformRangePartition.partition(UniformRangePartition.java:104)
              at org.apache.tajo.master.querymaster.Repartitioner.scheduleRangeShuffledFetches(Repartitioner.java:355)
              at org.apache.tajo.master.querymaster.Repartitioner.scheduleFragmentsForNonLeafTasks(Repartitioner.java:301)
              at org.apache.tajo.master.querymaster.SubQuery$InitAndRequestContainer.schedule(SubQuery.java:790)
              at org.apache.tajo.master.querymaster.SubQuery$InitAndRequestContainer.transition(SubQuery.java:636)
              at org.apache.tajo.master.querymaster.SubQuery$InitAndRequestContainer.transition(SubQuery.java:617)
              at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385)
              at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
              at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
              at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
              at org.apache.tajo.master.querymaster.SubQuery.handle(SubQuery.java:594)
              at org.apache.tajo.master.querymaster.Query$SubQueryCompletedTransition.executeNextBlock(Query.java:574)
              at org.apache.tajo.master.querymaster.Query$SubQueryCompletedTransition.transition(Query.java:607)
              at org.apache.tajo.master.querymaster.Query$SubQueryCompletedTransition.transition(Query.java:560)
              at org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:362)
              at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
              at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
              at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
              at org.apache.tajo.master.querymaster.Query.handle(Query.java:660)
              at org.apache.tajo.master.querymaster.Query.handle(Query.java:58)
              at org.apache.tajo.master.TajoAsyncDispatcher.dispatch(TajoAsyncDispatcher.java:137)
              at org.apache.tajo.master.TajoAsyncDispatcher$1.run(TajoAsyncDispatcher.java:79)
              at java.lang.Thread.run(Thread.java:744)
      
      1. TAJO-713.patch
        13 kB
        Jihoon Son

        Activity

        Hide
        jihoonson Jihoon Son added a comment -

        Submitted a patch on RB.
        https://reviews.apache.org/r/19677/

        Show
        jihoonson Jihoon Son added a comment - Submitted a patch on RB. https://reviews.apache.org/r/19677/
        Hide
        jihoonson Jihoon Son added a comment -

        Since I got +1 from RB, I committed the patch.

        Show
        jihoonson Jihoon Son added a comment - Since I got +1 from RB, I committed the patch.
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-0.8.0-build #50 (See https://builds.apache.org/job/Tajo-0.8.0-build/50/)
        TAJO-713: Missing INET4 in UniformRangePartition. (jihoon) (jihoonson: rev 4152d095416f1bcd3da9bcae2eb26d07ff2719e7)

        • CHANGES.txt
        • tajo-core/tajo-core-backend/src/test/java/org/apache/tajo/engine/planner/TestUniformRangePartition.java
        • tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/engine/planner/UniformRangePartition.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-0.8.0-build #50 (See https://builds.apache.org/job/Tajo-0.8.0-build/50/ ) TAJO-713 : Missing INET4 in UniformRangePartition. (jihoon) (jihoonson: rev 4152d095416f1bcd3da9bcae2eb26d07ff2719e7) CHANGES.txt tajo-core/tajo-core-backend/src/test/java/org/apache/tajo/engine/planner/TestUniformRangePartition.java tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/engine/planner/UniformRangePartition.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-master-build #146 (See https://builds.apache.org/job/Tajo-master-build/146/)
        TAJO-713: Missing INET4 in UniformRangePartition. (jihoon) (jihoonson: rev 85b38348f1da1dec5c187b72ae6ceaf887303b8b)

        • tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/engine/planner/UniformRangePartition.java
        • tajo-core/tajo-core-backend/src/test/java/org/apache/tajo/engine/planner/TestUniformRangePartition.java
        • CHANGES.txt
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-master-build #146 (See https://builds.apache.org/job/Tajo-master-build/146/ ) TAJO-713 : Missing INET4 in UniformRangePartition. (jihoon) (jihoonson: rev 85b38348f1da1dec5c187b72ae6ceaf887303b8b) tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/engine/planner/UniformRangePartition.java tajo-core/tajo-core-backend/src/test/java/org/apache/tajo/engine/planner/TestUniformRangePartition.java CHANGES.txt

          People

          • Assignee:
            jihoonson Jihoon Son
            Reporter:
            jihoonson Jihoon Son
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development