Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-7753

Storage IPFS: Better peer selection algorithm

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Storage - Other
    • None

    Description

      The current implementation randomly selects one provider and assigns it as the executor responsible for executing the query. It does not check reachability, latency, bandwidth between the foreman and the remote peer, etc.

      A better peer selection algorithm ideally takes into account the above factors, in order to minimize the total query execution time.

      As a subset of the bigger issue, if a provider has multiple advertised `Multiaddress`es, it is also important to know what network address to use to do networking. The current implementation prefers globally routable addresses over local-only addresses, and does not check reachability.

      Attachments

        Activity

          People

            dbw9580 Bowen Ding
            dbw9580 Bowen Ding
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: