GitLab

Improve Query Perforamance

Note: Readdirnames does not return entries for "." or ".." but it a
good idea to skip dirs/files starting with '.' anyway.

filepath.Walk() sorts the names and calls lstat() on each entry, both of
which are unnecessary when all we need are the key names in random order.

For large datastores can improve the performance by about 50%.

Limin number of goroutines stuck on Sync syscall

It is rising number of running threads of go-ipfs from 12 to 200+ when
the flatfs datastore works on slowish HDDs.

This is to prevent race that can happen while GCing the repo
Walk will build list of files and one of those files can be removed
by GC, currently it causes a failure which shouldn't be the case.

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>

Print formatted string using Errorf

merge ipfs org changes back into jbenet/go-datastore

We have some random crashes there and it would be good
to know what are erros that are causing those crashes.

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>

add log statement for retry

vendor

Batching

implement batch ops for different datastore types

rename Transaction to Batch

Revert "add in support for batched writes"

add in benchmarks for put and batchput

move batching into separate interface

address concerns from PR

regrab old code