[NIFI-8615] ExecuteScript with python when use module directory

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 1.13.2
• Component/s: Extensions
• Labels: Debian
• Environment: debian linux
• Flags: Important
• Assignee: Unassigned
• Reporter: Aldric DUPONT
• Created: 18/May/21 13:53
• Updated: 15/Nov/23 21:11
• Resolved: 15/Nov/23 21:11

Description

 

I use additional module "pytz" in python, this module directory is locate in "/usr/local/lib/python3.9/site-packages"

I use  sample1 in "Script Body" : (no comment)

from org.python.core.util.FileUtil import wrap
from org.apache.nifi.processors.script import ExecuteScript
from datetime import datetime, tzinfo

flow_file = session.get()

import pytz
from pytz import timezone

utc = pytz.utc
eastern = timezone('US/Eastern')

flow_file = session.putAttribute(flow_file, 'timezone', eastern.zone)
flow_file = session.putAttribute(flow_file, 'utc', utc.zone)

flow_file = session.putAttribute(flow_file, 'test', 'salut')

session.transfer(flow_file, ExecuteScript.REL_SUCCESS)

 

and sample2 with comment : __ 

from org.python.core.util.FileUtil import wrap
from org.apache.nifi.processors.script import ExecuteScript
from datetime import datetime, tzinfo

flow_file = session.get()

"""

import pytz
from pytz import timezone

utc = pytz.utc
eastern = timezone('US/Eastern')

flow_file = session.putAttribute(flow_file, 'timezone', eastern.zone)
flow_file = session.putAttribute(flow_file, 'utc', utc.zone)

"""

flow_file = session.putAttribute(flow_file, 'test', 'salut')

session.transfer(flow_file, ExecuteScript.REL_SUCCESS)

 

Try 1

When use sample1 in version 1.13.2 ExecuteScript make error " : 
ERROR [Timer-Driven Process Thread-4] o.a.nifi.processors.script.ExecuteScript ExecuteScript[id=790ea9a2-0179-1000-a662-30042349b329] Failed to process session due to org.apache.nifi.processor.exception.ProcessException: javax.script.ScriptException: ImportError: No module named pytz in <script> at line number 6: org.apache.nifi.processor.exception.ProcessException: javax.script.ScriptException: ImportError: No module named pytz in <script> at line number 6
org.apache.nifi.processor.exception.ProcessException: javax.script.ScriptException: ImportError: No module named pytz in <script> at line number 6

with version 1.12.1 we have no error and I have output flowfile with new attribute

 

Try 2

When use sample1 in version 1.13.2 ExecuteScript make error " : **

ERROR [Timer-Driven Process Thread-4] o.a.nifi.processors.script.ExecuteScript ExecuteScript[id=790ea9a2-0179-1000-a662-30042349b329] Failed to process session due to org.apache.nifi.processor.exception.ProcessException: javax.script.ScriptException: ImportError: No module named pytz in <script> at line number 6: org.apache.nifi.processor.exception.ProcessException: javax.script.ScriptException: ImportError: No module named pytz in <script> at line number 6
org.apache.nifi.processor.exception.ProcessException: javax.script.ScriptException: ImportError: No module named pytz in <script> at line number 6

after I change Script boby with sample2 and nifi return the same error .... retry and the same ... ExecutreScript is bogue and we can't show the flowfile in queue.

ERROR [Timer-Driven Process Thread-4] o.a.nifi.processors.script.ExecuteScript ExecuteScript[id=790ea9a2-0179-1000-a662-30042349b329] Failed to process session due to org.apache.nifi.processor.exception.ProcessException: javax.script.ScriptException: ImportError: No module named pytz in <script> at line number 6: org.apache.nifi.processor.exception.ProcessException: javax.script.ScriptException: ImportError: No module named pytz in <script> at line number 6
org.apache.nifi.processor.exception.ProcessException: javax.script.ScriptException: ImportError: No module named pytz in <script> at line number 6