Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-4860

Presto/Trino Cannot parse partition value '\N' of type 'integer' for partition column

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • None
    • 0.12.1
    • None
    • 3

    Description

      Hudi has the new {}HIVE_DEFAULT_PARTITION{}  as the fallback one.

      Presto/Trino seem to covert it to `\N`. https://github.com/codope/trino/blob/f7c969c1cc6a10f601ca522a7161384a7bf56996/plugin/trino-hive/src/main/java/io/trino/plugin/hive/HivePartitionKey.java#L44

      It works with this fix

      git diff
      diff --git a/plugin/trino-hudi/src/main/java/io/trino/plugin/hudi/HudiPageSourceProvider.java b/plugin/trino-hudi/src/main/java/io/trino/plugin/hudi/HudiPageSourceProvider.java
      index 1c72175860..d10dbbaac7 100644
      --- a/plugin/trino-hudi/src/main/java/io/trino/plugin/hudi/HudiPageSourceProvider.java
      +++ b/plugin/trino-hudi/src/main/java/io/trino/plugin/hudi/HudiPageSourceProvider.java
      @@ -159,7 +159,7 @@ public class HudiPageSourceProvider
                   String partitionValue,
                   TypeSignature partitionDataType)
           {
      -        if (isNull(partitionValue)) {
      +        if (isNull(partitionValue) || partitionValue.equals("\\N")) {
                   return Optional.empty();
               }
        

      Attachments

        Issue Links

          Activity

            People

              codope Sagar Sumit
              codope Sagar Sumit
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: