Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4482

Pig pushes matches operator to HCatLoader causing script to fail

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.12.0
    • None
    • None
    • None

    Description

      HCatLoader fails with as it cannot understand the matches operator. Even if we don't push down, specifying regular expression in partition key will be bad for performance as it will scan the whole table. Need to see if hcat can indeed support basic wildcard regular expression and translate it to LIKE clause in database query.

      java.io.IOException: MetaException(message:Error parsing partition filter;
      lexer error: null; exception NoViableAltException(11@[]))
              at
      org.apache.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:95)
              at
      org.apache.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:59)
              at org.apache.hcatalog.pig.HCatLoader.setLocation(HCatLoader.java:121)
      

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              rohini Rohini Palaniswamy
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: