Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-2624

JDBC-to-Avro processors handle BigDecimals as Strings

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.3.0
    • Component/s: Extensions
    • Labels:
      None

      Description

      The original SQL processors implemented BigDecimal values as Strings for
      Avro, as the version of Avro it used (1.7.6) did not support DECIMAL type.

      As of Avro 1.7.7 (AVRO-1402), this type is supported and so the SQL /HiveQL processors should be updated to handle BigDecimals correctly if possible.

      UPDATED: This JIRA improved only ExecuteSQL and QueryDatabaseTable processors. SelectHiveQL is removed from target. Hive tables can be queried by ExecuteSQL/QueryDatabaseTable once NIFI-3093 is resolved (and logical types will also be supported with those processors).

        Attachments

          Issue Links

          depends upon

          New Feature - A new feature of the product, which has yet to be developed. AVRO-1497 Add LogicalType support to Java

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. AVRO-1402 Support for DECIMAL type

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          duplicates

          Bug - A problem which impairs or prevents the functions of the product. NIFI-2048 ExecuteSQL converts BigDecimal to strings in Avro

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. NIFI-2531 SQL-to-Avro processors do not convert BIGINT correctly

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. NIFI-3093 HIVE Support for ExecuteSQL/QueryDatabaseTable/GenerateTableFetch

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #1142

          Web Link GitHub Pull Request #1798

            Activity

              People

              • Assignee:
                ijokarumawak Koji Kawamura
                Reporter:
                mattyb149 Matt Burgess
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: