Uploaded image for project: 'Crunch (Retired)'
  1. Crunch (Retired)
  2. CRUNCH-533

Support custom TableInputFormats

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.13.0
    • IO
    • None

    Description

      There are certain situations where a custom HBase TableInputFormat might help with performance improvements. While we could require them to create a completely custom HBaseSource, with a minor change consumer could be able to implement the pattern described in the blog very easily (e.g. they own still own their implementation but can easily integrate with Crunch).

      [1] - http://blog.cloudera.com/blog/2015/06/how-to-scan-salted-apache-hbase-tables-with-region-specific-key-ranges-in-mapreduce/

      Attachments

        1. CRUNCH-533.patch
          5 kB
          Micah Whitacre

        Issue Links

          Activity

            People

              mkwhitacre Micah Whitacre
              mkwhitacre Micah Whitacre
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: