Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-3568

TestRowSetCompactionSkipWithBudgetingConstraints fails when run on some nodes

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.18.0
    • 1.18.0
    • None
    • None

    Description

      The TestCompaction.TestRowSetCompactionSkipWithBudgetingConstraints scenario fails with the error like below when run on a machine with relatively high memory (it might be just a Docker instance with tiny actual memory allocated, but having the access to the /proc filesystem of the host machine). The full test log is attached.

      src/kudu/tablet/compaction-test.cc:908: Failure
      Value of: JoinStrings(sink.logged_msgs(), "\n")
      Expected: has substring "removed from compaction input due to memory constraints"
        Actual: "I20240425 10:13:05.497732 3573764 compaction-test.cc:902] CompactRowSetsOp complete. Timing: real 0.673s\tuser 0.669s\tsys 0.004s Metrics: {\"bytes_written\":4817,\"cfile_cache_hit\":90,\"cfile_cache_hit_bytes\":4310,\"cfile_cache_miss\":330,\"cfile_cache_miss_bytes\":3794180,\"cfile_init\":41,\"delta_iterators_relevant\":40,\"dirs.queue_time_us\":503,\"dirs.run_cpu_time_us\":338,\"dirs.run_wall_time_us\":1780,\"drs_written\":1,\"lbm_read_time_us\":1951,\"lbm_reads_lt_1ms\":494,\"lbm_write_time_us\":1767,\"lbm_writes_lt_1ms\":132,\"mutex_wait_us\":189,\"num_input_rowsets\":10,\"peak_mem_usage\":2147727,\"rows_written\":20,\"thread_start_us\":242,\"threads_started\":5}" (of type std::string)
      

      For extra information, below is 10 lines from /proc/meminfo file on a node where the test failed:

      # cat /proc/meminfo  | head -10
      MemTotal:       527417196 kB
      MemFree:        96640684 kB
      MemAvailable:   363590980 kB
      Buffers:        15352304 kB
      Cached:         246687576 kB
      SwapCached:      1294016 kB
      Active:         214889608 kB
      Inactive:       189745504 kB
      Active(anon):   133110648 kB
      Inactive(anon): 16977280 kB
      

      Attachments

        1. test-failure.log.xz
          2 kB
          Alexey Serbin

        Activity

          People

            araina Ashwani Raina
            aserbin Alexey Serbin
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: