Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-13330

Improve HDFS tests

    XMLWordPrintableJSON

Details

    • Test
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 8.1, 9.0
    • Hadoop Integration, hdfs, Tests
    • None

    Description

      Currently there are failures with HDFS tests intermittently. Some of these are due to resource constraints on the Apache Jenkins machines others are due to poor test assumptions.

      Related JIRAs:

      Changes:

      • Consolidate hdfs configuration into HdfsTestUtil
      • Ensure socketTimeout long enough for HDFS tests
      • Ensure HdfsTestUtil.getClientConfiguration used in tests
      • Replace deprecated HDFS calls
      • Use try-with-resources to ensure closing of HDFS resources

      Attachments

        1. SOLR-13330.patch
          59 kB
          Kevin Risden

        Issue Links

          is related to

          Test - A new unit, integration or system test. SOLR-13338 HdfsAutoAddReplicasIntegrationTest failures

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. SOLR-11010 OutOfMemoryError in tests when using HDFS BlockCache

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. SOLR-12040 HdfsBasicDistributedZkTest & HdfsBasicDistributedZk2 fail on virtually every jenkins run

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. SOLR-11381 HdfsDirectoryFactory throws NPE on cleanup because file system has been closed

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SOLR-9961 RestoreCore needs the option to download files in parallel.

          • Major - Major loss of function.
          • Patch Available

          Test - A new unit, integration or system test. SOLR-13297 StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3

          • Major - Major loss of function.
          • Closed
          supercedes

          Test - A new unit, integration or system test. SOLR-6008 HDFS tests are using local filesystem because solr.hdfs.home is set to a local filesystem path.

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #609

          Activity

            People

              krisden Kevin Risden
              krisden Kevin Risden
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m