Uploaded image for project: 'Apache Gora'
  1. Apache Gora
  2. GORA-33

Read map entries are all DIRTY by default

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 0.1-incubating
    • Fix Version/s: 0.3
    • Component/s: gora-hbase
    • Labels:
      None

      Description

      I'm using the following schema with the hbase module:

      {
      "type": "record",
      "name": "Request",
      "namespace": "ch.test.generated",
      "fields" : [
      {
      "name": "data",
      "type":

      { "type": "map", "values": "long" }

      }
      ]
      }

      In my map I may have hundreds of entries. Persisting them is fine. Getting the row, adding a new map entry and persisting it again seems to be a problem though. I can see the additional column in the hbase shell but it looks like all columns from the map are written to the row again which is a huge overhead every time I add a new entry. After looking through the code I saw that all map entries have the DIRTY state just after getting the row. Setting the state of all entries to CLEAN just after reading the row and before adding the new entry resolved the issue. The default state for all read map entries should be CLEAN.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                ylangisc Yves Langisch
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: