GitLab

fixes #5260

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>

when sending blocks in bitswap, close streams asynchronously

commands/files: add error messages for `cp` paths

 unixfs: refactor `precalcNextBuf`

unixfs: fix `dagTruncate` to preserve node type

Otherwise, we tie up the bitswap worker until the other side responds with an EOF.

fixes #5247
related to https://github.com/libp2p/go-libp2p-net/issues/28

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>

License: MIT
Signed-off-by: Lucas Molas <schomatis@gmail.com>

License: MIT
Signed-off-by: Lucas Molas <schomatis@gmail.com>

Extract the original `FSNode` passed inside the `ipld.Node` argument and modify
its `Blocksizes` (removing all of them and re-adding the ones that were not
truncated). In contrast, the replaced code was creating a new `FSNode` that was
not preserving some of the features of the original one.

Change `TRUNC_HASH` values in `sharness` that were created with the bug to the
correct values.

License: MIT
Signed-off-by: Lucas Molas <schomatis@gmail.com>

add trickle-dag support to the urlstore

fix truncating when already at the correct size

fixes #4518

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>

Improve paths in CoreApi

License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>

License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>

License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>

License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>

License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>

License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>

License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>

License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>

License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>

License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>

License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>

License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>

License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>

License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>

License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>

always try to read ahead by at least 5 blocks in the PBDagReader

update go-cid

alternative to #5243 that updates go-cid and all packages that depend on it

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>

fixes #5241

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>

importer: remove `UnixfsNode` from the balanced builder

Create new `loadBufNode` function to handle the `buf` logic which is unrelated
to the main `precalcNextBuf` logic of processing promises to fetch nodes.

License: MIT
Signed-off-by: Lucas Molas <schomatis@gmail.com>

Do not use `NewDagReader` just for the `RawNode` case.
Treat invalid UnixFS types in the same case.

License: MIT
Signed-off-by: Lucas Molas <schomatis@gmail.com>

The `UnixfsNode` structure has multiple pointers to many (non-complementary)
mutually exclusive node types, only some of them are active (not-`nil`) at a
given time in the code path which made the code too convoluted. Specifically,
the most important distinction between node types was being hidden: leaf nodes
vs internal (non-leaf) nodes.

Remove entirely the use of `UnixfsNode` from the `balanced` package replacing it
in turn with the newly created `FSNodeOverDag` structure that represents the
UnixFS node encoded inside the DAG node, primarily used for internal node
representations. Leaf nodes are handled exclusively in the `NewLeafDataNode`
encapsulating its multiple representations (that we're previously exposed in
`UnixfsNode` as conflicting pointers).

The `builder.go` file has been completely rewritten, although the basic DAG
creation algorithm has been preserved (extending a full DAG by creating a new
root and linking the old one as its child), the most significant modification
has been in the loop of `Layout` that now only handles internal nodes (i.e.,
nodes with `depth` bigger than zero) to be able to adapt `fillNodeRec` to only
that scenario (avoiding the replace logic of the zero `depth` case with the
defective `Set` function, now removed). The `fillNodeRec` now explicitly returns
the `ipld.Node` and the size of the file data it's storing to propagate it
upwards into the DAG.

The `DagBuilderHelper` was heavily extended to incorporate `ipld.Node` functions
that would replace the `UnixfsNode` ones used by the balanced builder:
`NewLeafNode()`, `NewLeafDataNode()` and `AddNodeAndClose()`. Also, the
`ProcessFileStore` function was incorporated to encapsulate all the logic
related to the Filestore support which was scattered throughout the builder
logic, the `offset` that was being passed through most functions is now a part
of the `DagBuilderHelper`.

This has turned out to be a rather big commit, it should have been split into
more smaller and logically cohesive commits, but the `UnixfsNode` was too
entangled inside the logic and that would have required a progressive
modification of the `UnixfsNode` structure as well, which wasn't possible as it
is still being used by the balanced builder (the same reason why most of the
`UnixfsNode`-related functions cannot yet be removed, leaving the `helpers.go`
file mostly untouched).

License: MIT
Signed-off-by: Lucas Molas <schomatis@gmail.com>

unixfs: fix `FSNode` accessor in `NewDirectoryFromNode`