Uploaded image for project: 'Accumulo'
  1. Accumulo
  2. ACCUMULO-3764

Improve RandomWalk scripts

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • None
    • 2.0.0
    • test

    Description

      in test/system/randomwalk/bin/copy-config.sh

      "$HADOOP_PREFIX/bin/hadoop" fs -rmr randomwalk 2>/dev/null
      

      RandomWalk should not try to write to the root of HDFS. This is likely to be disallowed by HDFS permissions.

      "$HADOOP_PREFIX/bin/hadoop" fs -setrep 3 randomwalk/config.tgz
      

      It would be nice to use some context to avoid setrep'ing to a value higher than the allowed max or the number of datanodes (e.g. don't need to setrep at all if we only have one datanode). hdfs dfsadmin -report might have some info that could be scraped?

      Attachments

        Activity

          People

            Unassigned Unassigned
            elserj Josh Elser
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: