Consider following storage table defn inside a fact:
<x_fact_table cube_name="sample_cube" name="fact2" weight="200.0"
xsi:schemaLocation="uri:lens:cube:0.1 cube-0.1.xsd ">
<table_desc external="true" field_delimiter=","
<column comment="Time column" name="dt" type="STRING"/>
In an event a new partition is added to the external table location
"/tmp/examples/fact2_local" then I wish to add a new partition on the
fact2, however I have no way to find what all facts are built on
external table location "/tmp/examples/fact2_local". We can possibly do
it by matching the location, however that doesn't seem to be quite
nice.. Consider for a JDBC source the table_location is kind of dummy as
its not really used to query the content from that location. JDBCDriver
expects a table with the name as storageName_factName in the target
datastore, thus no indication on which all facts to be updated.
Problem Statement: Current storage_table definition doesn't give me
enough detail to find where all partitions needs to be added given a new
partition is added to an external table.
I propose that we add a table_name property as part of table_desc and
provide following API's: