Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-187

simple distributed dfs random data writer & sort example applications

    XMLWordPrintableJSON

Details

    • Test
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.1.1
    • 0.2.0
    • None
    • None

    Description

      These are the examples/benchmark programs that I've been using to test Hadoop map/reduce with. The first is a program that runs 10 maps/node and each map writes 1 gig of random data to a dfs file as a SequenceFile of BytesWritable/BytesWritable.

      The second uses the identity map and reduce to sort the data and write it out to dfs.

      Attachments

        1. sort-write.patch
          14 kB
          Owen O'Malley

        Activity

          People

            omalley Owen O'Malley
            omalley Owen O'Malley
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: