Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-5478

IndexTool mapper task should not timeout

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 5.0.0, 4.15.0
    • 5.1.0
    • None
    • None

    Description

      In the old design, the IndexTool MR job mapper first scanned the data table rows one by one using a Phoenix client code, then constructed the index rows and finally sent these row mutations to region servers to update the rows on the index table regions. In the new design, this entire process is done on the server side (within a coprocessor). So, the mapper just issues one RPC call to instruct the coprocessor to build the entire table region. This RPC call can timeout if the table region is large. The temporary solution that is currently used is to set very large timeout values. We should break up single table region rebuild into smaller operations and eliminate setting large timeout values.

      Attachments

        1. PHOENIX-5478.master.001.patch
          22 kB
          Kadir OZDEMIR
        2. PHOENIX-5478.master.002.patch
          22 kB
          Kadir OZDEMIR
        3. PHOENIX-5478.master.003.patch
          24 kB
          Kadir OZDEMIR
        4. PHOENIX-5478.master.addendum.patch
          4 kB
          Kadir OZDEMIR
        5. PHOENIX-5478.master.addendum2.patch
          2 kB
          Kadir OZDEMIR

        Issue Links

          Activity

            People

              kozdemir Kadir OZDEMIR
              kozdemir Kadir OZDEMIR
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 40m
                  2h 40m