Lucene - Core
  1. Lucene - Core
  2. LUCENE-3667

Consider changing how we set the number of threads to use to run tests.

    Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      The current way we set the number of threads to use is not expressive enough for some systems. My quad core with hyper threading is recognized as 8 CPUs - since I can only override the number of threads to use per core, 8 is as low as I can go. 8 threads can be problematic for me - just the amount of RAM used sometimes can toss me into heavy paging because I only have 8 GB of RAM - the heavy paging can cause my whole system to come to a crawl. Without hacking the build, I don't think I have a lot of workarounds.

      I'd like to propose that switch from using threadsPerProcessor to threadCount. In some ways, it's not as nice, because it does not try to scale automatically per system. But that auto scaling is often not ideal (hyper threading, wanting to be able to do other work at the same time), so perhaps we just default to 1 or 2 threads and devs can override individually?

      1. LUCENE-3667.patch
        15 kB
        Robert Muir
      2. LUCENE-3667.patch
        35 kB
        Robert Muir
      3. LUCENE-3667.patch
        66 kB
        Robert Muir
      4. LUCENE-3667.patch
        100 kB
        Robert Muir
      5. LUCENE-3667.patch
        101 kB
        Robert Muir

        Activity

        Mark Miller created issue -
        Robert Muir made changes -
        Field Original Value New Value
        Attachment LUCENE-3667.patch [ 12508598 ]
        Robert Muir made changes -
        Attachment LUCENE-3667.patch [ 12508933 ]
        Robert Muir made changes -
        Attachment LUCENE-3667.patch [ 12508941 ]
        Robert Muir made changes -
        Attachment LUCENE-3667.patch [ 12508947 ]
        Robert Muir made changes -
        Attachment LUCENE-3667.patch [ 12508953 ]

          People

          • Assignee:
            Mark Miller
            Reporter:
            Mark Miller
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:

              Development