Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-4160 Vectorized Query Execution in Hive
  3. HIVE-4684

Query with filter constant on left of "=" and column expression on right does not vectorize

    XMLWordPrintableJSON

Details

    Description

      select dmachineid from factsqlengineam_vec_orc where 1073 = dmachineid + 1;

      Does not go down the vectorization path.

      Output:

      hive> select dmachineid from factsqlengineam_vec_orc where 1073 = dmachineid + 1;
      Total MapReduce jobs = 1
      Launching Job 1 out of 1
      Number of reduce tasks is set to 0 since there's no reduce operator
      Validating if vectorized execution is applicable
      Cannot vectorize the plan: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hiv
      e.ql.exec.vector.expressions.gen.FilterLongScalarEqualLongColumn
      Starting Job = job_201306061504_0038, Tracking URL = http://localhost:50030/jobdetails.jsp?jobid=job_201306061504_0038
      Kill Command = c:\Hadoop\hadoop-1.1.0-SNAPSHOT\bin\hadoop.cmd job -kill job_201306061504_0038
      Hadoop job information for Stage-1: number of mappers: 8; number of reducers: 0
      2013-06-07 10:25:30,932 Stage-1 map = 0%, reduce = 0%
      2013-06-07 10:25:39,953 Stage-1 map = 25%, reduce = 0%
      2013-06-07 10:25:42,959 Stage-1 map = 49%, reduce = 0%, Cumulative CPU 8.172 sec
      2013-06-07 10:25:43,962 Stage-1 map = 49%, reduce = 0%, Cumulative CPU 8.172 sec
      ...

      Attachments

        1. Hive-4684.0.patch
          2 kB
          Sarvesh Sakalanaga
        2. Hive-4684.1.patch
          2 kB
          Sarvesh Sakalanaga
        3. HIVE-4684.1.patch
          114 kB
          Jitendra Nath Pandey
        4. HIVE-4684.2.patch
          114 kB
          Jitendra Nath Pandey
        5. HIVE-4684.3.patch
          115 kB
          Jitendra Nath Pandey

        Activity

          People

            jnp Jitendra Nath Pandey
            ehans Eric N. Hanson
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: