[NIFI-1208] ListenSyslog spin-loops CPU, spikes load to 150%

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.4.0
• Fix Version/s: 0.4.0
• Component/s: Extensions
• Environment: Raspbian Jessie (Debian-based), Raspberry PI 2, 1GHz x 4cores, 1GB RAM, Oracle JDK 8 for ARM
• Assignee: Bryan Bende
• Reporter: Andrew Grande
• Created: 20/Nov/15 23:49
• Updated: 25/Nov/15 17:53
• Resolved: 24/Nov/15 02:37

Description

I've installed today's NiFI 0.4.0 snapshot on the latest Raspberry PI and configured a syslog listener. After forwarding my RPI syslogs to this NiFi listener, things seem to work ok (for now just sending to a remote cluster for collection).

However, 'top' shows that the nifi process taxes CPU at around 150%, varying. ListenSyslog stats show 1,500,000 tasks per a sliding 5min window.

Setup: create a ListenSyslog on port 10001.
As a root:

1. edit /etc/rsyslog.conf file and add

   *.*    @127.0.0.1:10001

   at the end

2. service rsyslog restart

You can send test messages to syslog like this:

logger "This is the test message!"