Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5213

Dynamic Partitions don't work with an apostrophe or a non-english character

    Details

    • Type: Bug
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: Impala 2.5.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Epic Color:
      ghx-label-4

      Activity

      Hide
      jhalaria Ankit Jhalaria added a comment -

      1) Creating dynamic partitions with strings that have an apostrophe or a non-english character, causes impala to fail.
      2) To reproduce the issue, partition a table with a value like Val d'Oise. [Create a partition column which has apostrophe in it ]
      3) You will see that the catalog manager would throw
      E0412 20:21:48.668634 19385 catalog-server.cc:89] TableLoadingException: Failed to load metadata for table: as_agg_f6fb66fa_myuda1
      CAUSED BY: IllegalStateException: Invalid partition name: state_c10=Val d'Oise

      Show
      jhalaria Ankit Jhalaria added a comment - 1) Creating dynamic partitions with strings that have an apostrophe or a non-english character, causes impala to fail. 2) To reproduce the issue, partition a table with a value like Val d'Oise. [Create a partition column which has apostrophe in it ] 3) You will see that the catalog manager would throw E0412 20:21:48.668634 19385 catalog-server.cc:89] TableLoadingException: Failed to load metadata for table: as_agg_f6fb66fa_myuda1 CAUSED BY: IllegalStateException: Invalid partition name: state_c10=Val d'Oise
      Hide
      neil_gluent Neil Johnson added a comment -

      We're seeing the same impact when using square brackets and carat:

      "^", "[", "]"

      This was not an issue in CDH5.5 but has been tested as failing in CDH5.8 and up.

      Show
      neil_gluent Neil Johnson added a comment - We're seeing the same impact when using square brackets and carat: "^", " [", "] " This was not an issue in CDH5.5 but has been tested as failing in CDH5.8 and up.
      Hide
      neil_gluent Neil Johnson added a comment -

      It would be good to know the rules for limiting certain characters and when they were introduced.

      Show
      neil_gluent Neil Johnson added a comment - It would be good to know the rules for limiting certain characters and when they were introduced.

        People

        • Assignee:
          Unassigned
          Reporter:
          jhalaria Ankit Jhalaria
        • Votes:
          1 Vote for this issue
          Watchers:
          3 Start watching this issue

          Dates

          • Created:
            Updated:

            Development