Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4540

Suspended tasks that are not assigned to the StreamThread need to be closed before new active and standby tasks are created

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.10.2.0
    • 0.10.2.0
    • streams
    • None

    Description

      When partition assignment happens we first try and add the active tasks and then add the standby tasks. The problem with this is that a new active task might already be an existing suspended standby task. if this is the case then when the active task initialises it will throw an exception from RocksDB:
      Caused by: org.rocksdb.RocksDBException: IO error: lock /tmp/kafka-streams-7071/kafka-music-charts/1_1/rocksdb/all-songs/LOCK: No locks available

      We need to make sure we have removed an closed any no-longer assigned Suspended tasks before creating new tasks.

      Attachments

        Issue Links

          Activity

            People

              damianguy Damian Guy
              damianguy Damian Guy
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: