Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-11840

when multi insert the inputformat becomes OneNullRowInputFormat

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsAdd voteVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Blocker
    • Resolution: Unresolved
    • 0.14.0, 1.2.1
    • 0.14.1
    • Hive
    • None

    Description

      example:
      from portrait.rec_feature_feedback a
      insert overwrite table portrait.test1 select iid, feedback_15day, feedback_7day, feedback_5day, feedback_3day, feedback_1day where l_date = '2015-09-09' and bid in ('949722CF_12F7_523A_EE21_E3D591B7E755')
      insert overwrite table portrait.test2 select iid, feedback_15day, feedback_7day, feedback_5day, feedback_3day, feedback_1day where l_date = '2015-09-09' and bid in ('test')
      insert overwrite table portrait.test3 select iid, feedback_15day, feedback_7day, feedback_5day, feedback_3day, feedback_1day where l_date = '2015-09-09' and bid in ('F7734668_CC49_8C4F_24C5_EA8B6728E394')

      when single insert it works.but multi insert when i select * from test1:
      NULL NULL NULL NULL NULL NULL.

      i see "explain extended"
      Path -> Alias:
      -mr-10006portrait.rec_feature_feedback

      {l_date=2015-09-09, cid=Cyiyaowang, bid=F7734668_CC49_8C4F_24C5_EA8B6728E394} [a]
      -mr-10007portrait.rec_feature_feedback{l_date=2015-09-09, cid=Czgc_pc, bid=949722CF_12F7_523A_EE21_E3D591B7E755} [a]
      Path -> Partition:
      -mr-10006portrait.rec_feature_feedback{l_date=2015-09-09, cid=Cyiyaowang, bid=F7734668_CC49_8C4F_24C5_EA8B6728E394}


      Partition
      base file name: bid=F7734668_CC49_8C4F_24C5_EA8B6728E394
      input format: org.apache.hadoop.hive.ql.io.OneNullRowInputFormat
      output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
      partition values:
      bid F7734668_CC49_8C4F_24C5_EA8B6728E394
      cid Cyiyaowang
      l_date 2015-09-09

      but when single insert:
      Path -> Alias:
      hdfs://bfdhadoopcool/warehouse/portrait.db/rec_feature_feedback/l_date=2015-09-09/cid=Czgc_pc/bid=949722CF_12F7_523A_EE21_E3D591B7E755 [a]
      Path -> Partition:
      hdfs://bfdhadoopcool/warehouse/portrait.db/rec_feature_feedback/l_date=2015-09-09/cid=Czgc_pc/bid=949722CF_12F7_523A_EE21_E3D591B7E755
      Partition
      base file name: bid=949722CF_12F7_523A_EE21_E3D591B7E755
      input format: org.apache.hadoop.mapred.TextInputFormat
      output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
      partition values:
      bid 949722CF_12F7_523A_EE21_E3D591B7E755
      cid Czgc_pc
      l_date 2015-09-09

      Attachments

        1. multi insert
          58 kB
          袁枫
        2. single__insert
          20 kB
          袁枫

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned Assign to me
            Feng Yuan 袁枫

            Dates

              Created:
              Updated:

              Slack

                Issue deployment