GitLab

* swap go-ipld-prime-proto for go-codec-dagpb

DO NOT MERGE

* feat(graphsync): update for linksystem

replace most instances of loader and storer with ipld.LinkSystem

* feat(graphsync): use trusted storage

* feat(deps): update to released ipld-prime

* ci(circle): use updated orb

* style(lint): fix lint errors
Co-authored-by: Daniel Martí <mvdan@mvdan.cc>

* update libp2p and remove dep on go-libp2p-peer.
* update gogo and rebuild.

upgrade to latest go-ipld-prime and make needed type conversions

reduce copies of temporary buffers in message write and unverified block store

* feat(deps): update ipld-prime to master

Update ipld-prime to master with serialization fixes

* feat(deps): update to tagged go-ipld-prime-proto

* test(benchmarks): add large file tests

add tests of large file processing to benchmarks

* feat(allocator): add allocator for memory backpressure

add an allocator that manages global memory allocations on responder and blocks peerresponsesenders
as needed

* feat(allocator): add method to release all peer memory

* feat(allocator): refactor w/ mutex

refactor allocator to remove go routine and address a few PR comments

* Update responsemanager/allocator/allocator.go
Co-authored-by: Steven Allen <steven@stebalien.com>

* fix(impl): update constants in readable form
Co-authored-by: Steven Allen <steven@stebalien.com>

* feat(message): switch to google protobuf

after tracking down an error in Unmarshal code generate by gogoprotobuf, and verifying this is a
bug in the library, which appears unmaintained, try switching to google's own golang protobuf tools

* fix(message): upgrade msgio

resolve bad message strings

* feat(message): initialize empty extensions

Initialize extensions to map if nil

* Update go-ipld-prime@v0.5.0

Simultaneously updates go-ipld-prime-proto, which also has changes to
match that version of go-ipld-prime.

* feat(deps): update ipld-prime near master

update to lastest needed sha for filecoin, reinstitute generated node tests

* feat(deps): update go-ipld-prime-prot
Co-authored-by: hannahhoward <hannah@hannahhoward.net>

Use cbor-gen encoding for speed bump on metadata

* feat(benchmarks): initial benchmark infrastructure

* fix(cidlink): mem allocations around link loading

* fix(deps): update to latest deps

use latest go-ipld-prime & go-ipld-prime-proto fixes

* fix(deps): remove unused badger code

* Updating go-ipld-prime to NodeAssembler era.

The 'testutil/chaintypes' codegen is currently dropped, and I ported
the testchain fixtures to using basicnode instead.  We can restore this
to using codegen soon, but it's easier to complete this set of changes
by temporarily switching to using basicnode.

Tests using 'NewUnencodableSelectorSpec' were discarded -- this more or
less exercised what would happen if an uninitialized zero value got
into a program, and this is now happily statically impossible.

Some tests are not passing; have not sussed yet.

* fix(deps): upgrade ipld-prime with bug fix

use ipld prime with fixed marshalling bug to get tests passing

* fix(lint): fix lint error
Co-authored-by: Eric Myhre <hash@exultant.us>

* feat(graphsync): add update to message

add update to message protobuf. also fix deserialization error with cancel requests

* feat(requestmanager): support updates for response hooks

Support sending request updates in incoming response hooks. Also factor hooks out of request manager

* refactor(hooks): make hooks approach consistent

for ease of use and learning in library, make hooks structure consistent across requestor and
responder

* feat(responsemanager): update request processing

Add the ability to processing update requests as needed

* test(responsemanager): add more tests for update behavior

* test(integration):add update integration test

Add test to verify the whole update flow

* fix(lint): fix lint error

* feat(deps): upgrade IPLD prime to last before refactor

* refactor(responsemanager): refactor traversal

switch to iterative traversal that is more amenable to interruption

* feat(peerresponsemanager): add bytes sent to peer response sender

Add a return value to SendResponse in peer response sender to return the number of block bytes
transmitted. Note: does not count unsent blocks. Also convert block size measurements to uint64

* feat(responsemanager): add response pausing

add first implementation of response pausing in response manager

* refactor(responsemanager): extract classes to simplify response manager

extract hooks as independant functionality

* test(responsemanager): add tests for block hooks and request hooks

* test(graphsync): add pause/resume integration test

* fix(responsemanager): fix directory misname

requesthooks.go directory -> requesthooks

* fix(tests): cleanup races & lint

* test(graphsync): fix flaky test

* refactor(tests): introduce testify

Introduce testify, cleanup lots of tests, add channel assertions to simplify channel tests, make
more readable

* refactor(tests): clean up error messages

* fix(deps): remove bitswap

remove accidentally added bitswap

* refactor(tests): put expected in correct position

Make sure for require.equal that the expected value is the first value

* ci(circle): switch to circle

Use configs from bitswap

* fix(deps): update and standardize

* fix(lint): fix lint errors

* fix(tests): relax timings for context cancels

Since we are not relying on context cancellation as anything but a test failsafe, relax timings
significantly for slower machines

* fix(test): fix minor test error

* fix(tests): minor timing fix

* fix(lint): fix lint errors

* fix(tests): relax timings for context cancels

Since we are not relying on context cancellation as anything but a test failsafe, relax timings

Removed mock selector spec, switch to using more real blockchain simulator

Remove the encode and decode on ipldbridge as part of ramp up to removing entirely
Also move selector encode/decode to within protobuf encoding

Incorporate go-ipld-prime-proto and write test to verify that graphsync works with it

This reverts commit e8245a51, reversing
changes made to 2cbb73ff.

To reduce future import cycles, and expose more types properly, move the root package to an
interface/types file and move the main implementation into /impl. This also exposes an interface
other implementers can replace.

Remove unneeded old dependencies

Utility functions to construct loaders/storers from a go-blockstore

update go-ipld-prime

update go-ipld-prime

update go-ipld-prime

Adds callbacks to manage connections, also removes network receiver methods from public graphsync
interface, and updates libp2p to handle go-libp2p-core refactor

Updates IPLD Bridge to use latest go-ipld-prime and runs and actual round trip test using GraphSync,
go-ipld-prime, and real selectors

Update the IPLD bridge for the newest version of IPLD prime and add a node builder method.

Create a prioritized task queue for tracking blocks of tasks between peers

Update the IPLD Bridge to take into account the new architecture around links