Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-7489

Create a Freon tool to simulate datanodes

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None

    Description

      We need a Freon tool to simulate a number of datanodes and coordinate with SCM to create a number of containers on the simulated datanodes. This will help to verify the capability of SCM to handle thousand of nodes and exabytes of data.

      Example usage: a simulation of 5K datanodes with 40K containers per datanode, i.e. simulating 1 exabyte of raw data. 

       

      ozone freon simulate-datanode -t 20 -n 5000 -c 40000

      Attachments

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            duongnguyen Duong Assign to me
            duongnguyen Duong
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment