Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-413

Run map/reduce job to populate initial index table if data table is big

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Resolved
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
    • old issue number:
      282

      Description

      Instead of internally running an UPSERT SELECT to initially populate the index table when the data table is big, we should run a map/reduce job. That way, in the event of failure, the job can pick up where it left off. Plus users will have better visibility into the % completion. Once we start collecting stats, we'll have a better idea of the size of the data table when an index is created and can make the decision based on that.

        Attachments

          Activity

            People

            • Assignee:
              dhacker1341 Dave Hacker
              Reporter:
              jamestaylor James Taylor
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: