Uploaded image for project: 'Apache Gora'
  1. Apache Gora
  2. GORA-33

Read map entries are all DIRTY by default

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • 0.1-incubating
    • 0.3
    • gora-hbase
    • None

    Description

      I'm using the following schema with the hbase module:

      {
      "type": "record",
      "name": "Request",
      "namespace": "ch.test.generated",
      "fields" : [
      {
      "name": "data",
      "type":

      { "type": "map", "values": "long" }

      }
      ]
      }

      In my map I may have hundreds of entries. Persisting them is fine. Getting the row, adding a new map entry and persisting it again seems to be a problem though. I can see the additional column in the hbase shell but it looks like all columns from the map are written to the row again which is a huge overhead every time I add a new entry. After looking through the code I saw that all map entries have the DIRTY state just after getting the row. Setting the state of all entries to CLEAN just after reading the row and before adding the new entry resolved the issue. The default state for all read map entries should be CLEAN.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              ylangisc Yves Langisch
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: