Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7240 Scaling HDFS
  3. HDFS-12244

Ozone: the static cache provided by ContainerCache does not work in Unit tests

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • HDFS-7240
    • ozone
    • None

    Description

      Since a cluster may have >1 datanodes, a static ContainerCache is shared among the datanodes. When one datanode shutdown, the cache will be shutdown so that the other datanodes cannot use the cache any more. It results in "leveldb.DBException: Closed"

      org.iq80.leveldb.DBException: Closed
      	at org.fusesource.leveldbjni.internal.JniDB.get(JniDB.java:75)
      	at org.apache.hadoop.utils.LevelDBStore.get(LevelDBStore.java:109)
      	at org.apache.hadoop.ozone.container.common.impl.KeyManagerImpl.getKey(KeyManagerImpl.java:116)
      	at org.apache.hadoop.ozone.container.common.impl.Dispatcher.handleGetSmallFile(Dispatcher.java:677)
      	at org.apache.hadoop.ozone.container.common.impl.Dispatcher.smallFileHandler(Dispatcher.java:293)
      	at org.apache.hadoop.ozone.container.common.impl.Dispatcher.dispatch(Dispatcher.java:121)
      	at org.apache.hadoop.ozone.container.common.transport.server.ratis.ContainerStateMachine.dispatch(ContainerStateMachine.java:94)
      	...
      

      Attachments

        Issue Links

          Activity

            People

              aengineer Anu Engineer
              szetszwo Tsz-wo Sze
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: