Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-40686 Support data masking and redacting built-in functions
  3. SPARK-42070

Change the default value of argument of Mask udf from -1 to NULL

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.4.0
    • 3.4.0
    • SQL
    • None

    Description

      In the udf 'mask', using -1 as ignore parameter in String type argument is not a standard way, hence, it is better to change the value of ignore argument from -1 to NULL.

      Note: SPARK-40687 , has recently implemented udf mask , which uses -1 as the default argument to ignore the masking option, As no Spark version release has occurred since then, this new change will not cause backward compatibility issues

      Attachments

        Activity

          People

            vinodkc Vinod KC
            vinodkc Vinod KC
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: