Uploaded image for project: 'Apache AsterixDB'
  1. Apache AsterixDB
  2. ASTERIXDB-1414

Insert tweets with existed keys

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Not A Problem
    • None
    • None
    • ING - Ingestion
    • None

    Description

      When using the tweet id as key, some times there will have duplicate key exception that pop up in the terminal. Here is the error message.

      org.apache.asterix.common.exceptions.FrameDataException: org.apache.hyracks.storage.am.common.exceptions.TreeIndexDuplicateKeyException: Failed to insert key since key already exists.
      at org.apache.asterix.common.dataflow.AsterixLSMInsertDeleteOperatorNodePushable.nextFrame(AsterixLSMInsertDeleteOperatorNodePushable.java:120)
      at org.apache.asterix.external.feed.dataflow.FeedRuntimeInputHandler.process(FeedRuntimeInputHandler.java:265)
      at org.apache.asterix.external.feed.dataflow.FeedRuntimeInputHandler.nextFrame(FeedRuntimeInputHandler.java:127)
      at org.apache.asterix.external.operators.FeedMetaStoreNodePushable.nextFrame(FeedMetaStoreNodePushable.java:176)
      at org.apache.hyracks.control.nc.Task.pushFrames(Task.java:349)
      at org.apache.hyracks.control.nc.Task.run(Task.java:297)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      at java.lang.Thread.run(Thread.java:745)
      Caused by: org.apache.hyracks.storage.am.common.exceptions.TreeIndexDuplicateKeyException: Failed to insert key since key already exists.
      at org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTree.insert(LSMBTree.java:360)
      at org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTree.modify(LSMBTree.java:333)
      at org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.modify(LSMHarness.java:353)
      at org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.forceModify(LSMHarness.java:333)
      at org.apache.hyracks.storage.am.lsm.common.impls.LSMTreeIndexAccessor.forceInsert(LSMTreeIndexAccessor.java:158)
      at org.apache.asterix.common.dataflow.AsterixLSMInsertDeleteOperatorNodePushable.nextFrame(AsterixLSMInsertDeleteOperatorNodePushable.java:103)
      ... 8 more

      Attachments

        Activity

          People

            idleft Xikui Wang
            idleft Xikui Wang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: