[MINIFICPP-1592] TailFileTests transiently fails

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.11.0
• Labels: MiNiFi-CPP-Hygiene
• Epic Link: Fix transient test failures
• Assignee: Gábor Gyimesi
• Reporter: Gábor Gyimesi
• Created: 15/Jun/21 07:52
• Updated: 24/Jun/21 07:40
• Resolved: 22/Jun/21 10:48

Description

Test case "TailFile reads from a single file when Initial Start Position is set to Current Time with rollover" of TailFileTests suite transiently fails. Failure found in ubuntu16.04-gcc4.8 build but can be reproduced on ubuntu20.04 environment as well, but only in Release build.

[2021-06-15 07:48:57.001] [LogTestController] [info] Setting log level for org::apache::nifi::minifi::processors::TailFile to trace
[2021-06-15 07:48:57.001] [LogTestController] [info] Setting log level for org::apache::nifi::minifi::processors::LogAttribute to debug
[2021-06-15 07:48:57.002] [org::apache::nifi::minifi::processors::TailFile] [info] Found no stored state
[2021-06-15 07:48:57.002] [org::apache::nifi::minifi::processors::TailFile] [info] Legacy state file TailFileState.2396d624-cdae-11eb-9b23-0242ac110002 not found (this is OK)
[2021-06-15 07:48:57.002] [org::apache::nifi::minifi::processors::LogAttribute] [debug] FlowFiles To Log: 0
[2021-06-15 07:48:57.002] [org::apache::nifi::minifi::processors::LogAttribute] [debug] Maximum Payload Line Length: 80
[2021-06-15 07:48:57.002] [org::apache::nifi::minifi::processors::LogAttribute] [debug] Logged 0 flow files
[2021-06-15 07:48:57.002] [LogTestController] [info] Successfully found Logged 0 flow files in log output.
[2021-06-15 07:48:57.002] [org::apache::nifi::minifi::processors::TailFile] [debug] Received path /tmp/gt.HkGp2w, file minifi-tmpfile.txt
[2021-06-15 07:48:57.002] [org::apache::nifi::minifi::processors::TailFile] [debug] TailState /tmp/gt.HkGp2w/minifi-tmpfile.txt: /tmp/gt.HkGp2w, minifi-tmpfile.txt, 0, 0
[2021-06-15 07:48:57.002] [org::apache::nifi::minifi::processors::TailFile] [info] State of the TailFile processor tailfileProc:
[2021-06-15 07:48:57.002] [org::apache::nifi::minifi::processors::TailFile] [info] /tmp/gt.HkGp2w/minifi-tmpfile.txt => { name: minifi-tmpfile.txt, position: 34, checksum: 1535622921, last_read_time: 1623743337002 }
[2021-06-15 07:48:57.002] [org::apache::nifi::minifi::processors::TailFile] [debug] Searching for files rolled over after last read time: 1623743337002
[2021-06-15 07:48:57.002] [org::apache::nifi::minifi::processors::TailFile] [debug] Performing file listing against /tmp/gt.HkGp2w
[2021-06-15 07:48:57.002] [org::apache::nifi::minifi::processors::TailFile] [debug] File minifi-tmpfile.txt.old.1 with mtime 1623743336 matches rolling filename pattern minifi-tmpfile\..*
[2021-06-15 07:48:57.002] [org::apache::nifi::minifi::processors::TailFile] [debug] Tailing file /tmp/gt.HkGp2w/minifi-tmpfile.txt from 0
[2021-06-15 07:48:57.002] [org::apache::nifi::minifi::processors::TailFile] [trace] Looking for delimiter 0xA
[2021-06-15 07:48:57.002] [org::apache::nifi::minifi::processors::TailFile] [debug] Opening /tmp/gt.HkGp2w/minifi-tmpfile.txt
[2021-06-15 07:48:57.002] [org::apache::nifi::minifi::processors::TailFile] [trace] Read 17 bytes of input
[2021-06-15 07:48:57.002] [org::apache::nifi::minifi::processors::TailFile] [info] TailFile minifi-tmpfile.txt for 17 bytes
[2021-06-15 07:48:57.002] [org::apache::nifi::minifi::processors::TailFile] [info] 1 flowfiles were received from TailFile input
[2021-06-15 07:48:57.003] [org::apache::nifi::minifi::processors::LogAttribute] [debug] FlowFiles To Log: 0
[2021-06-15 07:48:57.003] [org::apache::nifi::minifi::processors::LogAttribute] [debug] Maximum Payload Line Length: 80
[2021-06-15 07:48:57.003] [org::apache::nifi::minifi::processors::LogAttribute] [info] Logging for flow file 
--------------------------------------------------
Standard FlowFile Attributes
UUID:2396ed26-cdae-11eb-9b2d-0242ac110002
EntryDate:2021-06-15 07:48:57.002
lineageStartDate:2021-06-15 07:48:57.002
Size:17 Offset:0
FlowFile Attributes Map Content
key:absolute.path value:/tmp/gt.HkGp2w/minifi-tmpfile.txt
key:filename value:minifi-tmpfile.0-16.txt
key:flow.id value:test
key:path value:/tmp/gt.HkGp2w
FlowFile Resource Claim Content
Content Claim:.//1623743337000-0
--------------------------------------------------
[2021-06-15 07:48:57.003] [org::apache::nifi::minifi::processors::LogAttribute] [debug] Logged 1 flow files
[2021-06-15 07:49:00.005] [LogTestController] [info] Failed to find Logged 2 flow files in log output.~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
TailFileTests is a Catch v1.6.1 host application.
Run with -? for options-------------------------------------------------------------------------------
TailFile reads from a single file when Initial Start Position is set to Current
Time with rollover
-------------------------------------------------------------------------------
/nifi-minifi-cpp/extensions/standard-processors/tests/unit/TailFileTests.cpp:1596
.............................................................................../nifi-minifi-cpp/extensions/standard-processors/tests/unit/TailFileTests.cpp:1627: FAILED:
  REQUIRE( LogTestController::getInstance().contains("Logged 2 flow files") )
with expansion:
  false