README.md 9.05 KB
Newer Older
Jeromy's avatar
Jeromy committed
1
# ipfs implementation in go.
2
[![GoDoc](https://godoc.org/github.com/ipfs/go-ipfs?status.svg)](https://godoc.org/github.com/ipfs/go-ipfs) [![Build Status](https://travis-ci.org/ipfs/go-ipfs.svg?branch=master)](https://travis-ci.org/ipfs/go-ipfs)
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
3

Jeromy's avatar
Jeromy committed
4 5 6 7 8
Ipfs is a global, versioned, peer-to-peer filesystem. It combines good ideas from
Git, BitTorrent, Kademlia, SFS, and the Web. It is like a single bittorrent swarm,
exchanging git objects. IPFS provides an interface as simple as the HTTP web, but
with permanence built in. You can also mount the world at /ipfs.

9
For more info see: https://github.com/ipfs/ipfs
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
10 11

Please put all issues regarding IPFS _design_ in the
12 13
[ipfs repo issues](https://github.com/ipfs/ipfs/issues).
Please put all issues regarding go IPFS _implementation_ in [this repo](https://github.com/ipfs/go-ipfs/issues).
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
14

Richard Littauer's avatar
Richard Littauer committed
15 16 17 18 19 20 21 22
## Security Issues

The IPFS protocol and its implementations are still in heavy development. This means that there may be problems in our protocols, or there may be mistakes in our implementations. And -- though IPFS is not production-ready yet -- many people are already running nodes in their machines. So we take security vulnerabilities very seriously. If you discover a security issue, please bring it to our attention right away!

If you find a vulnerability that may affect live deployments -- for example, by exposing a remote execution exploit -- please send your report privately to security@ipfs.io. Please DO NOT file a public issue.

If the issue is a protocol weakness that cannot be immediately exploited or something not yet deployed, just discuss it openly.

Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
23 24
## Install

25
The canonical download instructions for IPFS are over at: http://ipfs.io/docs/install/
Muneeb Ali's avatar
Muneeb Ali committed
26

27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45
## Install prebuilt packages

We use [gobuilder.me](https://gobuilder.me), a great service that automatically builds a release on every commit.

You can see the latest builds for your platform at these links:

- [`release` - the last released version](https://gobuilder.me/github.com/ipfs/go-ipfs/cmd/ipfs?branch=release)  **<-- recommended**
- [`master` - development, stable](https://gobuilder.me/github.com/ipfs/go-ipfs/cmd/ipfs?branch=master)

From there:
- click "Download" on the build for your platform
- open/extract the archive
- move `ipfs` to your path (`install.sh` can do it for you)


## Build from Source

### Prerequisite: Install Go

Jeromy's avatar
Jeromy committed
46
First, you'll need go. If you don't have it: [Download Go 1.5.2+](https://golang.org/dl/).
47 48

You'll need to add Go's bin directories to your `$PATH` environment variable e.g., by adding these lines to your `/etc/profile` (for a system-wide installation) or `$HOME/.profile`:
Muneeb Ali's avatar
Muneeb Ali committed
49 50 51 52 53
```
export PATH=$PATH:/usr/local/go/bin
export PATH=$PATH:$GOPATH/bin
```

54
(If you run into trouble, see the [Go install instructions](https://golang.org/doc/install))
55 56 57

### Download + Compile IPFS

58
Then:
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
59 60

```
61 62 63
$ go get -d github.com/ipfs/go-ipfs
$ cd $GOPATH/src/github.com/ipfs/go-ipfs
$ make install
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
64 65
```

Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
66
NOTES:
67

Jeromy's avatar
Jeromy committed
68
* `git` is required in order for `go get` to fetch
69 70 71 72
all dependencies.
* Package managers often contain out-of-date `golang` packages.
  Compilation from source is recommended.
* If you are interested in development, please install the development
Jeromy's avatar
Jeromy committed
73
dependencies as well.
Jeromy's avatar
Jeromy committed
74
* *WARNING: older versions of OSX FUSE (for Mac OS X) can cause kernel panics when mounting!*
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
75
  We strongly recommend you use the [latest version of OSX FUSE](http://osxfuse.github.io/).
76
  (See https://github.com/ipfs/go-ipfs/issues/177)
77
* For more details on setting up FUSE (so that you can mount the filesystem), see the docs folder
78
* Shell command completion is available in `misc/completion/ipfs-completion.bash`. Read [docs/command-completion.md](docs/command-completion.md) to learn how to install it.
79
* See the [init examples](https://github.com/ipfs/examples/tree/master/examples/init) for how to connect IPFS to systemd or whatever init system your distro uses.
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
80

Jeromy's avatar
Jeromy committed
81 82
### Updating
ipfs has an updating tool that can be accessed through `ipfs update`. The tool is
Jeromy's avatar
Jeromy committed
83
not installed alongside ipfs in order to keep that logic independent of the main
Jeromy's avatar
Jeromy committed
84 85
codebase. To install ipfs update, either [download it here](https://gobuilder.me/github.com/ipfs/ipfs-update)
or install it from source with `go get -u github.com/ipfs/ipfs-update`.
Chas Leichner's avatar
Chas Leichner committed
86

Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
87 88 89
## Usage

```
drathir's avatar
drathir committed
90 91
USAGE:

92 93 94 95
    ipfs - global p2p merkle-dag filesystem

    ipfs [<flags>] <command> [<arg>] ...

drathir's avatar
drathir committed
96 97
    BASIC COMMANDS
    
98
        init          Initialize ipfs local configuration
Richard Littauer's avatar
Richard Littauer committed
99
        add <path>    Add a file to ipfs
100
        cat <ref>     Show ipfs object data
drathir's avatar
drathir committed
101
        get <ref>     Download ipfs objects
102
        ls <ref>      List links from an object
drathir's avatar
drathir committed
103 104 105 106 107 108 109 110 111 112
        refs <ref>    List hashes of links from an object
    
    DATA STRUCTURE COMMANDS
    
        block         Interact with raw blocks in the datastore
        object        Interact with raw dag nodes
        file          Interact with Unix filesystem objects
    
    ADVANCED COMMANDS
    
113 114
        daemon        Start a long-running daemon process
        mount         Mount an ipfs read-only mountpoint
drathir's avatar
drathir committed
115 116 117 118 119 120 121 122 123 124 125 126 127
        resolve       Resolve any type of name
        name          Publish or resolve IPNS names
        dns           Resolve DNS links
        pin           Pin objects to local storage
        repo gc       Garbage collect unpinned objects
    
    NETWORK COMMANDS
    
        id            Show info about ipfs peers
        bootstrap     Add or remove bootstrap peers
        swarm         Manage connections to the p2p network
        dht           Query the dht for values or peers
        ping          Measure the latency of a connection
128
        diag          Print diagnostics
drathir's avatar
drathir committed
129 130 131 132 133 134 135 136 137
    
    TOOL COMMANDS
    
        config        Manage configuration
        version       Show ipfs version information
        update        Download and apply go-ipfs updates
        commands      List all available commands
    
    Use 'ipfs <command> --help' to learn more about each command.
138 139


Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
140
```
141

142
## Getting Started
143 144 145

See also: http://ipfs.io/docs/getting-started/

Jeromy's avatar
Jeromy committed
146
To start using ipfs, you must first initialize ipfs's config files on your
147
system, this is done with `ipfs init`. See `ipfs init --help` for information on
Jeromy's avatar
Jeromy committed
148 149
the optional arguments it takes. After initialization is complete, you can use
`ipfs mount`, `ipfs add` and any of the other commands to explore!
150

Jeromy's avatar
Jeromy committed
151 152 153 154 155 156 157 158 159
### Some things to try

Basic proof of 'ipfs working' locally:

	echo "hello world" > hello
	ipfs add hello
	# This should output a hash string that looks something like:
	# QmT78zSuBmuS4z925WZfrqQ1qHaJ56DQaTfyMUF7F8ff5o
	ipfs cat <that hash>
160

Jeromy's avatar
Jeromy committed
161

162 163
### Docker usage

164
An ipfs docker image is hosted at [hub.docker.com/r/jbenet/go-ipfs](https://hub.docker.com/r/jbenet/go-ipfs/).
165
To make files visible inside the container you need to mount a host directory
166
with the `-v` option to docker. Choose a directory that you want to use to
167
import/export files from ipfs. You should also choose a directory to store
168 169 170 171
ipfs files that will persist when you restart the container.

    export ipfs_staging=</absolute/path/to/somewhere/>
    export ipfs_data=</absolute/path/to/somewhere_else/>
172
    
173
Make sure docker can access these folders:
174 175 176

    sudo chmod -R 777 /absolute/path/to/somewhere/
    sudo chmod -R 777 /absolute/path/to/somewhere_else/
177

178 179
Start a container running ipfs and expose ports 4001, 5001 and 8080:

180
    docker run -d --name ipfs_host -v $ipfs_staging:/export -v $ipfs_data:/data/ipfs -p 8080:8080 -p 4001:4001 -p 5001:5001 jbenet/go-ipfs:latest
181

Michael Lovci's avatar
Michael Lovci committed
182 183 184
Watch the ipfs log:

    docker logs -f ipfs_host
185

186 187 188
Wait for ipfs to start. ipfs is running when you see:

    Gateway (readonly) server
Michael Lovci's avatar
Michael Lovci committed
189
    listening on /ip4/0.0.0.0/tcp/8080
190

Michael Lovci's avatar
Michael Lovci committed
191
(you can now stop watching the log)
192

193 194 195 196 197
Run ipfs commands:

    docker exec ipfs_host ipfs <args...>

For example: connect to peers
198

199
    docker exec ipfs_host ipfs swarm peers
200

201 202 203 204 205

Add files:

    cp -r <something> $ipfs_staging
    docker exec ipfs_host ipfs add -r /export/<something>
206

207 208 209
Stop the running container:

    docker stop ipfs_host
210

211 212
#### Docker usage with VirtualBox/boot2docker (OSX and Windows)

213 214
Since docker is running in the boot2docker VM, you need to forward
relevant ports from the VM to your host for ipfs act normally. This is
215 216 217 218 219
accomplished with the following command:

    boot2docker ssh -L 5001:localhost:5001 -L 4001:localhost:4001 -L 8080:localhost:8080 -fN


Jeromy's avatar
Jeromy committed
220 221
### Troubleshooting
If you have previously installed ipfs before and you are running into
Jeromy's avatar
Jeromy committed
222
problems getting a newer version to work, try deleting (or backing up somewhere
223
else) your ipfs config directory (~/.ipfs by default) and rerunning `ipfs init`.
Jeromy's avatar
Jeromy committed
224 225
This will reinitialize the config file to its defaults and clear out the local
datastore of any bad entries.
226

227
For any other problems, check the [issues list](https://github.com/ipfs/go-ipfs/issues)
Jeromy's avatar
Jeromy committed
228 229 230
and if you dont see your problem there, either come talk to us on irc (freenode #ipfs) or
file an issue of your own!

231

232 233
## Contributing

Richard Littauer's avatar
Richard Littauer committed
234
Please see [Contribute.md](contribute.md)!
235

236 237
## Todo

238
An IPFS alpha version has been released in February 2015. Things left to be done are all marked as [Issues](https://github.com/ipfs/go-ipfs/issues)
239

Chas Leichner's avatar
Chas Leichner committed
240 241
## Development Dependencies

242
If you make changes to the protocol buffers, you will need to install the [protoc compiler](https://github.com/google/protobuf).
243 244 245 246

## License

MIT