Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-10279

Read Bigtable Rows by Prefix

Details

    • Wish
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • io-java-gcp

    Description

      BigtableIO.Read provides a withKeyRange method to specify Bigtable keys within a [start, end) range. Unfortunately, it doesn't seem to provide a way of reading rows by a common prefix, although Bigtable natively supports this feature:  https://cloud.google.com/bigtable/docs/cbt-reference#read_rows.

      Our use case, we have several "types" in our table, and each type is prefixed with the name of the type. The only other way to reading all rows with a specific prefix seems to use a RowFilter with row_key_regex_filter set, but it looks like that will result in a full table scan.

      Attachments

        Activity

          People

            Unassigned Unassigned
            rafi_kamal Rafi Kamal
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: