Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-5259

Provenance repo "failed to perform background maintenance procedures" due failing to read schema

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.6.0
    • None
    • None
    • None
    • Dockerized NiFi v1.6.0, with a link to a Registry instance, receiving data from MiNiFi java v0.4.0 and NiFi v1.6.0

    Description

      Seeing an odd error (ST below) with the Provenance Repo as a background task and also when attempting to query it. It's not getting a lot of data and the issue persists through restarts of the container and also stop/rm/docker-compose up of the container.

      Looking at the code, it's attempting to read the first record in the repo:
      final List<ProvenanceEventRecord> firstEvents = eventStore.getEvents(0, 1);
      Looking through the provenance record itself, it appears the event appears to just be missing that field altogether.

       

      2018-06-01 19:32:55,114 ERROR [Provenance Repository Maintenance-1] o.a.n.p.index.lucene.LuceneEventIndex Failed to perform background maintenance procedures
      java.io.IOException: Invalid Boolean value found when reading 'Repetition' of field 'Source System FlowFile Identifier'. Expected 0 or 1 but got 145
        at org.apache.nifi.repository.schema.SchemaRecordReader.readField(SchemaRecordReader.java:107)
        at org.apache.nifi.repository.schema.SchemaRecordReader.readRecord(SchemaRecordReader.java:72)
        at org.apache.nifi.provenance.EventIdFirstSchemaRecordReader.readRecord(EventIdFirstSchemaRecordReader.java:138)
        at org.apache.nifi.provenance.EventIdFirstSchemaRecordReader.nextRecord(EventIdFirstSchemaRecordReader.java:132)
        at org.apache.nifi.provenance.serialization.CompressableRecordReader.nextRecord(CompressableRecordReader.java:287)
        at org.apache.nifi.provenance.store.iterator.SequentialRecordReaderEventIterator.nextEvent(SequentialRecordReaderEventIterator.java:73)
        at org.apache.nifi.provenance.store.iterator.AuthorizingEventIterator.nextEvent(AuthorizingEventIterator.java:47)
        at org.apache.nifi.provenance.store.PartitionedEventStore.getEvents(PartitionedEventStore.java:214)
        at org.apache.nifi.provenance.store.PartitionedEventStore.getEvents(PartitionedEventStore.java:158)
        at org.apache.nifi.provenance.store.PartitionedEventStore.getEvents(PartitionedEventStore.java:148)
        at org.apache.nifi.provenance.index.lucene.LuceneEventIndex.performMaintenance(LuceneEventIndex.java:650)
        at org.apache.nifi.provenance.index.lucene.LuceneEventIndex.lambda$initialize$0(LuceneEventIndex.java:156)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

      Attachments

        Activity

          People

            markap14 Mark Payne
            jpercivall Joe Percivall
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: