Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11128

abstracting out the scale tests for FileSystem Contract tests

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Currently we have some scale tests for openstack and s3a. For now we'll just trust HDFS to handle files >5GB and delete thousands of file in a directory properly.
      We should abstract out the scale tests so it can be applied to all FileSystems.

      A few things to consider for scale tests:
      scale tests rely on the tester having good/stable upload bandwidth, might need large disk space. It needs to be configurable or optional.
      scale tests might need long time to finish, consider have test timeout configurable if possible

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                jyu@cloudera.com Juan Yu
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated: