Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17047

Allow table property to be populated to jobConf to make FixedLengthInputFormat work

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      To make FixedLengthInputFormat work in Hive, we need table specific value for the configuration "fixedlengthinputformat.record.length". Right now the best place would be table property. Unfortunately, table property is not alway populated to InputFormat configurations because of this in HiveInputFormat:

       
      PartitionDesc part = pathToPartitionInfo.get(hsplit.getPath().toString()); 
      if ((part != null) && (part.getTableDesc() != null)) { 
      

      Attachments

        1. HIVE-17047.1.patch
          0.9 kB
          Zhiyuan Yang
        2. HIVE-17047-branch-1.1.patch
          0.9 kB
          Zoltan Haindrich

        Activity

          People

            zhiyuany Zhiyuan Yang
            zhiyuany Zhiyuan Yang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: