Uploaded image for project: 'Jackrabbit Oak'
  1. Jackrabbit Oak
  2. OAK-8528

The Azure Journal implementation doesn't split after exceeding JOURNAL_LINE_LIMIT

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.18.0
    • Component/s: segment-azure
    • Labels:
      None

      Description

      The AzureJournalFile should split after exceeding 40_000 lines. However, it doesn't happen, which results in:

      06.08.2019 10:22:34.926 *WARN* [TarMK flush [/opt/aem/launcher/repository/segmentstore-composite-global]] org.apache.jackrabbit.oak.segment.file.FileStore Failed to flush the TarMK at /opt/aem/launcher/repository/segmentstore-composite-global
      java.io.IOException: null
          at com.microsoft.azure.storage.core.Utility.initIOException(Utility.java:737)
          at com.microsoft.azure.storage.blob.BlobOutputStreamInternal.appendBlock(BlobOutputStreamInternal.java:487)
          at com.microsoft.azure.storage.blob.BlobOutputStreamInternal.access$200(BlobOutputStreamInternal.java:52)
          at com.microsoft.azure.storage.blob.BlobOutputStreamInternal$3.call(BlobOutputStreamInternal.java:420)
          at com.microsoft.azure.storage.blob.BlobOutputStreamInternal$3.call(BlobOutputStreamInternal.java:417)
          at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
          at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
          at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
          at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
          at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
          at java.base/java.lang.Thread.run(Thread.java:834)
      Caused by: com.microsoft.azure.storage.StorageException: The committed block count cannot exceed the maximum limit of 50,000 blocks.
          at com.microsoft.azure.storage.StorageException.translateException(StorageException.java:89)
          at com.microsoft.azure.storage.core.StorageRequest.materializeException(StorageRequest.java:305)
          at com.microsoft.azure.storage.core.ExecutionEngine.executeWithRetry(ExecutionEngine.java:175)
          at com.microsoft.azure.storage.blob.CloudAppendBlob.appendBlock(CloudAppendBlob.java:414)
          at com.microsoft.azure.storage.blob.BlobOutputStreamInternal.appendBlock(BlobOutputStreamInternal.java:467)
          ... 9 common frames omitted 
      

        Attachments

          Activity

            People

            • Assignee:
              tomek.rekawek Tomek Rękawek
              Reporter:
              tomek.rekawek Tomek Rękawek
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: