Solr
  1. Solr
  2. SOLR-5907

The hdfs write cache can still cause a reader to see a corrupted state.

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: 4.7.1, 4.8, 6.0
    • Component/s: hdfs
    • Labels:
      None

      Description

      We should disable it by default and probably take it out of the default configs until we can track down the issues with it.

      1. SOLR-5907.patch
        1 kB
        Mark Miller
      2. SOLR-5907.patch
        1 kB
        Mark Miller

        Issue Links

          Activity

          Hide
          ASF subversion and git services added a comment -

          Commit 1581174 from Mark Miller in branch 'dev/trunk'
          [ https://svn.apache.org/r1581174 ]

          SOLR-5907: The hdfs write cache can cause a reader to see a corrupted state. It now defaults to off, and if you were using solr.hdfs.blockcache.write.enabled explicitly, you should set it to false.

          Show
          ASF subversion and git services added a comment - Commit 1581174 from Mark Miller in branch 'dev/trunk' [ https://svn.apache.org/r1581174 ] SOLR-5907 : The hdfs write cache can cause a reader to see a corrupted state. It now defaults to off, and if you were using solr.hdfs.blockcache.write.enabled explicitly, you should set it to false.
          Hide
          ASF subversion and git services added a comment -

          Commit 1581175 from Mark Miller in branch 'dev/branches/branch_4x'
          [ https://svn.apache.org/r1581175 ]

          SOLR-5907: The hdfs write cache can cause a reader to see a corrupted state. It now defaults to off, and if you were using solr.hdfs.blockcache.write.enabled explicitly, you should set it to false.

          Show
          ASF subversion and git services added a comment - Commit 1581175 from Mark Miller in branch 'dev/branches/branch_4x' [ https://svn.apache.org/r1581175 ] SOLR-5907 : The hdfs write cache can cause a reader to see a corrupted state. It now defaults to off, and if you were using solr.hdfs.blockcache.write.enabled explicitly, you should set it to false.
          Hide
          ASF subversion and git services added a comment -

          Commit 1581176 from Mark Miller in branch 'dev/branches/lucene_solr_4_7'
          [ https://svn.apache.org/r1581176 ]

          SOLR-5907: The hdfs write cache can cause a reader to see a corrupted state. It now defaults to off, and if you were using solr.hdfs.blockcache.write.enabled explicitly, you should set it to false.

          Show
          ASF subversion and git services added a comment - Commit 1581176 from Mark Miller in branch 'dev/branches/lucene_solr_4_7' [ https://svn.apache.org/r1581176 ] SOLR-5907 : The hdfs write cache can cause a reader to see a corrupted state. It now defaults to off, and if you were using solr.hdfs.blockcache.write.enabled explicitly, you should set it to false.
          Hide
          ASF subversion and git services added a comment -

          Commit 1581177 from Mark Miller in branch 'dev/trunk'
          [ https://svn.apache.org/r1581177 ]

          SOLR-5907: Fix messed up merge - conflicted twice and screwed up the second merge.

          Show
          ASF subversion and git services added a comment - Commit 1581177 from Mark Miller in branch 'dev/trunk' [ https://svn.apache.org/r1581177 ] SOLR-5907 : Fix messed up merge - conflicted twice and screwed up the second merge.
          Hide
          ASF subversion and git services added a comment -

          Commit 1581178 from Mark Miller in branch 'dev/branches/branch_4x'
          [ https://svn.apache.org/r1581178 ]

          SOLR-5907: Fix messed up merge - conflicted twice and screwed up the second merge.

          Show
          ASF subversion and git services added a comment - Commit 1581178 from Mark Miller in branch 'dev/branches/branch_4x' [ https://svn.apache.org/r1581178 ] SOLR-5907 : Fix messed up merge - conflicted twice and screwed up the second merge.
          Hide
          ASF subversion and git services added a comment -

          Commit 1581179 from Mark Miller in branch 'dev/branches/lucene_solr_4_7'
          [ https://svn.apache.org/r1581179 ]

          SOLR-5907: Fix messed up merge - conflicted twice and screwed up the second merge.

          Show
          ASF subversion and git services added a comment - Commit 1581179 from Mark Miller in branch 'dev/branches/lucene_solr_4_7' [ https://svn.apache.org/r1581179 ] SOLR-5907 : Fix messed up merge - conflicted twice and screwed up the second merge.
          Hide
          Steve Rowe added a comment -

          Mark, can this issue be resolved?

          Show
          Steve Rowe added a comment - Mark, can this issue be resolved?
          Hide
          Steve Rowe added a comment -

          Bulk close 4.7.1 issues

          Show
          Steve Rowe added a comment - Bulk close 4.7.1 issues
          Hide
          Mark Miller added a comment -

          What I committed didn't match the last patch somehow - it is missing:

          + boolean blockCacheWriteEnabled = params.getBool(BLOCKCACHE_WRITE_ENABLED, false);

          Show
          Mark Miller added a comment - What I committed didn't match the last patch somehow - it is missing: + boolean blockCacheWriteEnabled = params.getBool(BLOCKCACHE_WRITE_ENABLED, false);
          Hide
          Mark Miller added a comment -

          I filed: SOLR-6424 The hdfs block cache BLOCKCACHE_WRITE_ENABLED is not defaulting to false like it should.

          Show
          Mark Miller added a comment - I filed: SOLR-6424 The hdfs block cache BLOCKCACHE_WRITE_ENABLED is not defaulting to false like it should.

            People

            • Assignee:
              Mark Miller
              Reporter:
              Mark Miller
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development