GitLab

Also, reduce the overhead from logging.

And expose a separate function for _just_ getting want-blocks. When the user
runs `ipfs bitswap wantlist`, they expect to see everything the node is
currently looking for.
Co-Authored-By: dirkmc <dirkmdev@gmail.com>

This makes reading the docs much easier as it's clear what's "private" and
what's not.

fixes #238

This commit extends the bitswap protocol with two additional wantlist properties:

* WANT_HAVE/HAVE: Instead of asking for a block, a node can specify that they
  want to know if any peers "have" the block.
* WANT_HAVE_NOT/HAVE_NOT: Instead of waiting for a timeout, a node can explicitly
  request to be told immediately if their peers don't currently have the given
  block.

Additionally, nodes now tell their peers how much data they have queued to send
them when sending messages. This allows peers to better distribute requests,
keeping all peers busy but not overloaded.

Changes in this PR are described in: https://github.com/ipfs/go-bitswap/issues/186

* feat: parallelize reads

* feat: concurent engine task workers and concurrent bstore reads

* fix: lint

* fix: address review comments

* refactor: in BlockstoreManager wait for process.Closing() instead of Context.Done()

* fix: use channel size 0 for BlockstoreManager reads

* fix: change blockstore error logs from warnings to errors

* fix: flaky test

* fix: lint

feat: process response message blocks as a batch

send duplicate responses to the session peer manager to track latencies

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>

Re-setup provider search delay and rebroadcast delay on a per bitswap instance basis

tag peers in connection manager as they have outstanding requests for blocks to serve

fix #114

Add comments to all exported functions, extract the utils for creating instances in testnet.go,
moves integration tests to bitswap_test

BREAKING CHANGE: removed one constant -- rebroadcastDelay -- which I believe was unused

* HasBlockBufferSize and provideKeysBufferSize no longer matter as we have an
  infinite in-memory buffer.
* provideWorkersMax now defaults to 6 so changing this to 16 actually _increases
  memory consumption.

And remove all locks.

15 will _never_ succeed

This'll back up the queue but take a large load off the DHT.

Fixes #50.

Seperate want list into differentiated types - session tracking and regular

fix #13

fix race conditions while setting up wantlists by creating peer queues on demand

BREAKING CHANGE: PeerManager SendMessage signature changed

fix #51

Make Bitswap GetBlocks just create a temporary session and use that code

fix #52 fix #49

Integrate the ProviderQueryManager into the SessionPeerManager and bitswap in general

re #52, re #49

Move the job of splitting requests to its own package

Reduce duplicates through splits of requests

Add a unit test and do some additional decoupling