Uploaded image for project: 'S2Graph'
  1. S2Graph
  2. S2GRAPH-10

Add create table if not exist on TransferHFile loader

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: To Do
    • Priority: Trivial
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None

      Description

      for bulk load data into s2graph, loader project provide spark job to transfer TSV graph data into HFile.
      current implementation assumes that hbase table where this HFile will be loaded exist, but it would be convenient if TransferHFile check if given hbase table exist and create if it is not exist. creating hbase table with pre-split with byte ranges that s2graph use is not easily done on script level so it would be helpful to add create given hbase table if not exist with pre-split size on TransferHFile job.

      s2core project has Management.createTable which will create hbase table if table not exist so I think simply use Management.createTable would do necessary work for us on TransferHFile.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              steamshon DOYUNG YOON
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - 168h
                168h
                Remaining:
                Remaining Estimate - 168h
                168h
                Logged:
                Time Spent - Not Specified
                Not Specified