GitLab

* test(benchmarks): add large file tests

add tests of large file processing to benchmarks

* feat(allocator): add allocator for memory backpressure

add an allocator that manages global memory allocations on responder and blocks peerresponsesenders
as needed

* feat(allocator): add method to release all peer memory

* feat(allocator): refactor w/ mutex

refactor allocator to remove go routine and address a few PR comments

* Update responsemanager/allocator/allocator.go
Co-authored-by: Steven Allen <steven@stebalien.com>

* fix(impl): update constants in readable form
Co-authored-by: Steven Allen <steven@stebalien.com>

* test(benchmarks): add benchmark for go routine leak

* fix(notifications): shutdown notification queues

make sure all notification publishers are actually shut down, and don't start them automatically

* feat(message): switch to google protobuf

after tracking down an error in Unmarshal code generate by gogoprotobuf, and verifying this is a
bug in the library, which appears unmaintained, try switching to google's own golang protobuf tools

* fix(message): upgrade msgio

resolve bad message strings

* feat(message): initialize empty extensions

Initialize extensions to map if nil

feat(CHANGELOG): update for 0.3.0

update for 0.3.0 + style fixes

docs(CHANGELOG): update for 0.2.1

* feat(notifications): build notifications architecture

build an architecture via which we can pass on notifications

* feat(peerresponsesender): add notifications

pass notifications on from peer response sender based on message queue notifications

* feat(responsemanager): handle network errors

Pass on network errors through the response manager, pass block sent errors as well

* fix(notifications): send unique notifications by peer

* feat(responsemanager): subscriber per request

* Revert "fix(notifications): send unique notifications by peer"

This reverts commit 7bf368a05d14229b7523cb25068681d9c7e48246.

Release/0.2.0

Do not reconstruct a complicated selector on each call to selector validate

* Update go-ipld-prime@v0.5.0

Simultaneously updates go-ipld-prime-proto, which also has changes to
match that version of go-ipld-prime.

* feat(deps): update ipld-prime near master

update to lastest needed sha for filecoin, reinstitute generated node tests

* feat(deps): update go-ipld-prime-prot
Co-authored-by: hannahhoward <hannah@hannahhoward.net>

Use cbor-gen encoding for speed bump on metadata

Release/v0.1.2

* request context cancelled error

remove potential send on close channel -- only happens when context closes anyway

Update changelog for v0.1.2 release, also fix imports

* feat(benchmarks): initial benchmark infrastructure

* fix(cidlink): mem allocations around link loading

* fix(deps): update to latest deps

use latest go-ipld-prime & go-ipld-prime-proto fixes

* fix(deps): remove unused badger code

docs(CHANGELOG): update for v0.1.1

docs(CHANGELOG): update for v0.1.0 release

* feat(responsemanager): dedup-by-key extension

add deduping requests by a given key to the response manager

* feat(requestmanager): use dedup extension

use dedup extension to not dedup data across stores

* style(imports): fix import formatting

Fix import formatting via script. Also add script for import fixes and release log

* docs(CHANGELOG): add changelog, contributing

Add the changelog and a contributing guidelines doc

* feat(persistenceoptions): add unregister ability

add unregister ability to persistence options so we can create short lived options for single
requests

* fix(lint): fix lint issues

protobuf generated code was generated with old version of gogo-protobuf

We should run response hooks even on requests that are alerady completed

This reverts commit 31cc0d5e.

Needs further exploration

* feat(hooks): add extensions on complete

add the ability to send extensions with a final message

* refactor(hooks): complete listener->hook rename

All changes to date including pause requests & start paused, along with new adds for cleanups and checking of execution (#75)

* WIP

* feat(graphsync): pause/unpause requests

Allow graphsync requests to be paused and unpaused via request cancelling and DoNotSendCIDs
extension

* fix(requestmanager): refactor executor

remove extraneous allocation of closure functions

* feat(graphsync): support external request pauses

allow pausing requests imperatively via PauseRequest function

* fix(lint): fix lint errors

* feat(responsemanager): start requests paused

add the ability for a hook to pause a response right when it's first received

* feat(responsemanager): improve cancellation UX

provide a mechanism for responders to learn a requestor cancelled a request and for requestors to
learn a request was cancelled

* feat(requestmanager): process request cancelled status

process the responder returning a request cancelled error code and also support sentinel errors

* feat(executor): refactor to remove loader

remove loader, also only fire restart request as needed

* fix(asyncloader): load requests synchronously when possible

* fix(responsemanager): fix external pause

Fix external pauses missing a block

* fix(responsemanager): do not delay complete listener

Run complete listener in same thread as response processing, making it less susceptable to
interruption via cancel

* fix(responsemanager): fix context check

fix checking for context cancellation errors based off of the way ipld-prime does not wrap errors

* fix(responsemanager): more precise cancel

make cancels only get recorded if actual blocks are not sent -- otherwise the request is considered
complete -- and the complete hook always runs

* fix(requestmanager): handle non processed pauses

Handler the case where a pause is requested but never actually takes place

* refactor(responsemanager): handle cancels, correctly this time

Properly handle cancels for both paused and unpaused states

* fix(errors): remove regex cause it appears to be very slow

* fix(traverser): fix race condition for shutdown

make sure that the traverser is finished in the request executor

* fix(deps): mod tidy

* fix(executor): add back network error

* feat(responsemanager): add ability to pause response outside of a hook

Add the ability for anyone who knows a requestID & peer to pause a response at any time

* feat(responsemanager): add direct cancellations

add function to directly cancel responses from requestID. also, move query execution code to
seperate struct, internal for now

* fix(responsemanager): minor heap allocation optimization

* feat(responsemanager): support extensions on resume

Support sending extensions when resuming a request

* fix(lint): fix lint errors

Refactor request execution and use IPLD SkipMe functionality for proper partial results on a request (#70)

* refactor(requestmanager): refactor execution of requests

* feat(graphsync): properly use SkipMe from ipld to complete partial selections

* fix(requestmanager): remove unused function

Provides full implementation of do-no-send-cids on responder side

* feat(graphsync): add incoming block hook types

add types (not implemented) for incoming block hook

* feat(asyncloader): identify local loads

add a boolean value to AsyncLoadResult to determine if a request load was local

* fixup! feat(graphsync): add incoming block hook types

* feat(hooks): add block hooks plumbing

* feat(requestmanager): process block hooks

Process block hooks on each block, and connect last response to blocks

* feat(peerresponsemanager): add transactions

add the ability to do multple response operations with a gaurantee they will end up in a single
response

* refactor(lint): fix lint errors

add nil check for an empty task (task deleted but not finished removing from peer task queue