Solr
  1. Solr
  2. SOLR-7391

Use a time based expiration cache for one off hdfs FileSystem instances.

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 5.2, 6.0
    • Component/s: hdfs
    • Labels:
      None

      Description

      Most FileSystem clients are tied to a SolrCore and long lived, but in some cases where we don't have SolrCore context we create a short lived hdfs client object.

      Because these instances can be created via user generated actions, we don't want to be able to create too many of them - they have overhead that does not make them great candidates for being spun up for a single call.

        Activity

        Hide
        Mark Miller added a comment -

        Patch attatched.

        Show
        Mark Miller added a comment - Patch attatched.
        Hide
        ASF subversion and git services added a comment -

        Commit 1676070 from Mark Miller in branch 'dev/trunk'
        [ https://svn.apache.org/r1676070 ]

        SOLR-7391: Use a time based expiration cache for one off HDFS FileSystem instances.

        Show
        ASF subversion and git services added a comment - Commit 1676070 from Mark Miller in branch 'dev/trunk' [ https://svn.apache.org/r1676070 ] SOLR-7391 : Use a time based expiration cache for one off HDFS FileSystem instances.
        Hide
        ASF subversion and git services added a comment -

        Commit 1676073 from Mark Miller in branch 'dev/branches/branch_5x'
        [ https://svn.apache.org/r1676073 ]

        SOLR-7391: Use a time based expiration cache for one off HDFS FileSystem instances.

        Show
        ASF subversion and git services added a comment - Commit 1676073 from Mark Miller in branch 'dev/branches/branch_5x' [ https://svn.apache.org/r1676073 ] SOLR-7391 : Use a time based expiration cache for one off HDFS FileSystem instances.
        Hide
        Anshum Gupta added a comment -

        Bulk close for 5.2.0.

        Show
        Anshum Gupta added a comment - Bulk close for 5.2.0.

          People

          • Assignee:
            Mark Miller
            Reporter:
            Mark Miller
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development