GitLab

* fullrt: add experimental FullRT DHT client

The FullRT client periodically crawls the network to fill its local routing table and uses that to perform queries. It supports performing many provides or puts together taking advantage of efficiencies of grouping the DHT operations by where they will occur in the Kademlia space. Additionally, it has a more tunable function for determining when a query is complete that does not require waiting on any individual peer (which could be offline) to respond. This client is experimental and its exposed interfaces should be expected to change and break over time.

* crawler: starting peers with addresses and peers found during a crawl have their addresses extended. logging improved

* dht: move IpfsDHT options to the internal package. Make a breaking change to the filter interfaces to support more DHT implementations

* dht: GetClosestPeers now returns a slice of peers instead of a channel of peers since we have to wait for the query to complete to return the closest peers anyway

* dht: the subscriberNotifiee has been refactored to work more independently of the underlying message sender implementation

- go-libp2p
- protobuf (and regen)

Update for stream interface changes. See
https://github.com/libp2p/go-libp2p-core/releases/tag/v0.7.0 for details.

This reverts commit c9851849.

This reverts commit df4f28c3.

Ongoing work is being done in feat/dht-hardening-0.7 and this change isn't quite ready.

* Peer Diversity in the DHT

* Bootstrap when RT is empty and optimize allocations.
Co-authored-by: Steven Allen <steven@stebalien.com>

Bumps [github.com/ipfs/go-log](https://github.com/ipfs/go-log) from 1.0.3 to 1.0.4.
- [Release notes](https://github.com/ipfs/go-log/releases)
- [Commits](https://github.com/ipfs/go-log/compare/v1.0.3...v1.0.4)
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

These are all critical paths so we should try to do as little work as possible.

Bumps [github.com/libp2p/go-libp2p](https://github.com/libp2p/go-libp2p) from 0.8.0 to 0.8.1.
- [Release notes](https://github.com/libp2p/go-libp2p/releases)
- [Changelog](https://github.com/libp2p/go-libp2p/blob/master/NEWS.md)
- [Commits](https://github.com/libp2p/go-libp2p/compare/v0.8.0...v0.8.1)
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

After profiling allocations on a bootstrap node, I've noticed that
peerInfoToPBPeer is a very heavy source of allocations. This change should
improve the situation significantly.

Bumps [github.com/libp2p/go-libp2p](https://github.com/libp2p/go-libp2p) from 0.7.4 to 0.8.0.
- [Release notes](https://github.com/libp2p/go-libp2p/releases)
- [Changelog](https://github.com/libp2p/go-libp2p/blob/master/NEWS.md)
- [Commits](https://github.com/libp2p/go-libp2p/compare/v0.7.4...v0.8.0)
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Bumps [github.com/libp2p/go-libp2p-routing-helpers](https://github.com/libp2p/go-libp2p-routing-helpers) from 0.2.0 to 0.2.1.
- [Release notes](https://github.com/libp2p/go-libp2p-routing-helpers/releases)
- [Commits](https://github.com/libp2p/go-libp2p-routing-helpers/compare/v0.2.0...v0.2.1)
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Unfortunately, constructing a router is _not_ cheap. Cache it so we don't have
to re-compute it every time we get a query.

* fix Low Peers and Cleanup

* new RT management policy

* Add Kademlia async lookup implementation (replaces prior implementation)
* Add lookup events that allow full lookup reconstruction from logs
* Introduce lookup stopping condition, based on parameter "beta"
Co-authored-by: Adin Schmahmann <adin.schmahmann@gmail.com>

Allows specifying peer filter functions on query and on adding peers to the routing table. This patch also includes some reasonable default functions for a public-only and private-only DHT.
Co-authored-by: Will Scott <will@cypherpunk.email>
Co-authored-by: Steven Allen <steven@stebalien.com>

fix(test): TestFindPeerQuery and TestFindPeerQueryMinimal now refresh DHT routing tables before running. TestFindPeerQuery no longer runs with the race detector because it uses too many goroutines.

* feat: consume identify events to evaluate routing table addition
* fix: routing table no longer gets an update just because new messages have arrived or been sent
* fix: add already connected peers into the routing table before listening to events
Co-authored-by: Raúl Kripalani <raul.kripalani@gmail.com>
Co-authored-by: Aarsh Shah <aarshkshah1992@gmail.com>