Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-18280

Hive Support for SMB join to ignore hidden files

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Operators
    • Labels:
      None
    • Target Version/s:

      Description

      When doing an SMB join with ORC, we get the following error:
      FAILED: SemanticException Error 10141: Bucketed table metadata is not correct. Fix the metadata or don't use bucketed mapjoin, by setting hive.enforce.bucketmapjoin to false. The number of buckets for table its_purchase_line_item_mio partition create_month=2003-04/etl_process_run_id=36766536 is 512, whereas the number of files is 513

      The partition contained additional _mcinfo file, that caused the failure.

      We would like Hive to ignore such hidden/special files

        Attachments

          Activity

            People

            • Assignee:
              jcamachorodriguez Jesus Camacho Rodriguez
              Reporter:
              jcamachorodriguez Jesus Camacho Rodriguez
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: