Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-5841

When data columns get TTLed, we need inline index validation to publish a metric for this

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 5.1.0, 4.16.0
    • None
    • None

    Description

      We do index writes as full row writes. This means all columns keep get re-written to index and they have a current timestamp.

      However, if there is a column that did not get updated for a long time (like Created_By type of columns that don't change) index inline validation marks these as "Index has extra columns". We need to publish an extra metric to distinguish these cases since they are expected to be not matching rows.

      Attachments

        1. PHOENIX-5841.4.x.001.patch
          40 kB
          Gokcen Iskender
        2. PHOENIX-5841.4.x.002.patch
          40 kB
          Gokcen Iskender
        3. PHOENIX-5841.4.x.003.patch
          51 kB
          Gokcen Iskender
        4. PHOENIX-5841.master.001.patch
          23 kB
          Gokcen Iskender
        5. PHOENIX-5841.master.002.patch
          23 kB
          Gokcen Iskender
        6. PHOENIX-5841.master.003.patch
          34 kB
          Gokcen Iskender

        Issue Links

          Activity

            People

              giskender Gokcen Iskender
              giskender Gokcen Iskender
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2.5h
                  2.5h