Details
-
New Feature
-
Status: Open
-
Major
-
Resolution: Unresolved
-
1.15.0
-
None
Description
For very large files, fetchfile cannot be read to nifi at once, and no suitable processor shard read files are found, so expand the service and processor that reads files by line shards, writes files by shards, and makes it easy to process very large files with smaller resources.
针对超大文件,无法使用fetchfile一次性读取到nifi中,也没有找到合适的处理器分片读取文件,因此扩展按行分片读取文件,按分片写入文件的服务及处理器,便于使用较小的资源处理超大文件。