Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-11840

when multi insert the inputformat becomes OneNullRowInputFormat

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Blocker
    • Resolution: Unresolved
    • Affects Version/s: 0.14.0, 1.2.1
    • Fix Version/s: 0.14.1
    • Component/s: Hive
    • Labels:
      None

      Description

      example:
      from portrait.rec_feature_feedback a
      insert overwrite table portrait.test1 select iid, feedback_15day, feedback_7day, feedback_5day, feedback_3day, feedback_1day where l_date = '2015-09-09' and bid in ('949722CF_12F7_523A_EE21_E3D591B7E755')
      insert overwrite table portrait.test2 select iid, feedback_15day, feedback_7day, feedback_5day, feedback_3day, feedback_1day where l_date = '2015-09-09' and bid in ('test')
      insert overwrite table portrait.test3 select iid, feedback_15day, feedback_7day, feedback_5day, feedback_3day, feedback_1day where l_date = '2015-09-09' and bid in ('F7734668_CC49_8C4F_24C5_EA8B6728E394')

      when single insert it works.but multi insert when i select * from test1:
      NULL NULL NULL NULL NULL NULL.

      i see "explain extended"
      Path -> Alias:
      -mr-10006portrait.rec_feature_feedback

      {l_date=2015-09-09, cid=Cyiyaowang, bid=F7734668_CC49_8C4F_24C5_EA8B6728E394} [a]
      -mr-10007portrait.rec_feature_feedback{l_date=2015-09-09, cid=Czgc_pc, bid=949722CF_12F7_523A_EE21_E3D591B7E755} [a]
      Path -> Partition:
      -mr-10006portrait.rec_feature_feedback{l_date=2015-09-09, cid=Cyiyaowang, bid=F7734668_CC49_8C4F_24C5_EA8B6728E394}


      Partition
      base file name: bid=F7734668_CC49_8C4F_24C5_EA8B6728E394
      input format: org.apache.hadoop.hive.ql.io.OneNullRowInputFormat
      output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
      partition values:
      bid F7734668_CC49_8C4F_24C5_EA8B6728E394
      cid Cyiyaowang
      l_date 2015-09-09

      but when single insert:
      Path -> Alias:
      hdfs://bfdhadoopcool/warehouse/portrait.db/rec_feature_feedback/l_date=2015-09-09/cid=Czgc_pc/bid=949722CF_12F7_523A_EE21_E3D591B7E755 [a]
      Path -> Partition:
      hdfs://bfdhadoopcool/warehouse/portrait.db/rec_feature_feedback/l_date=2015-09-09/cid=Czgc_pc/bid=949722CF_12F7_523A_EE21_E3D591B7E755
      Partition
      base file name: bid=949722CF_12F7_523A_EE21_E3D591B7E755
      input format: org.apache.hadoop.mapred.TextInputFormat
      output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
      partition values:
      bid 949722CF_12F7_523A_EE21_E3D591B7E755
      cid Czgc_pc
      l_date 2015-09-09

        Attachments

        1. multi insert
          58 kB
          Feng Yuan
        2. single__insert
          20 kB
          Feng Yuan

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Feng Yuan Feng Yuan
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Due:
                Created:
                Updated: