Hive
  1. Hive
  2. HIVE-1321

bugs with temp directories, trailing blank fields in HBase bulk load

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.6.0
    • Fix Version/s: 0.6.0
    • Component/s: HBase Handler
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      HIVE-1295 had two bugs discovered during testing with production data:

      (1) extra directories may be present in the output directory depending on how the cluster is configured; we need to walk down these to find the column family directory

      (2) if a record ends with fields which are blank strings, the text format omits the corresponding Control-A delimiters, so we need to fill in blanks for these fields (instead of throwing ArrayIndexOutOfBoundsException)

        Issue Links

          Activity

          John Sichi created issue -
          John Sichi made changes -
          Field Original Value New Value
          Link This issue relates to HIVE-1295 [ HIVE-1295 ]
          John Sichi made changes -
          Attachment HIVE-1321.1.patch [ 12442641 ]
          John Sichi made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Namit Jain made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Resolution Fixed [ 1 ]
          Carl Steinbach made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              John Sichi
              Reporter:
              John Sichi
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development