README.md 9.87 KB
Newer Older
Richard Littauer's avatar
Richard Littauer committed
1
# IPFS implementation in Go
2
[![GoDoc](https://godoc.org/github.com/ipfs/go-ipfs?status.svg)](https://godoc.org/github.com/ipfs/go-ipfs) [![Build Status](https://travis-ci.org/ipfs/go-ipfs.svg?branch=master)](https://travis-ci.org/ipfs/go-ipfs)
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
3

Richard Littauer's avatar
Richard Littauer committed
4
IPFS is a global, versioned, peer-to-peer filesystem. It combines good ideas from
Jeromy's avatar
Jeromy committed
5 6 7 8
Git, BitTorrent, Kademlia, SFS, and the Web. It is like a single bittorrent swarm,
exchanging git objects. IPFS provides an interface as simple as the HTTP web, but
with permanence built in. You can also mount the world at /ipfs.

Richard Littauer's avatar
Richard Littauer committed
9
For more info see: https://github.com/ipfs/ipfs.
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
10 11

Please put all issues regarding IPFS _design_ in the
12
[ipfs repo issues](https://github.com/ipfs/ipfs/issues).
Richard Littauer's avatar
Richard Littauer committed
13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33
Please put all issues regarding Go IPFS _implementation_ in [this repo](https://github.com/ipfs/go-ipfs/issues).

## Table of Contents

- [Security Issues](#security-issues)
- [Install](#install)
  - [Install prebuilt packages](#install-prebuilt-packages)
  - [Build from Source](#build-from-source)
  - [Prerequisite: Install Go](#prerequisite-install-go)
  - [Download + Compile IPFS](#download--compile-ipfs)
  - [Development Dependencies](#development-dependencies)
- [Updating](#updating)
- [Usage](#usage)
- [Getting Started](#getting-started)
  - [Some things to try](#some-things-to-try)
  - [Docker usage](#docker-usage)
    - [Docker usage with VirtualBox/boot2docker (OSX and Windows)](#docker-usage-with-virtualboxboot2docker-osx-and-windows)
- [Troubleshooting](#troubleshooting)
- [Contributing](#contributing)
- [Todo](#todo)
- [License](#license)
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
34

Richard Littauer's avatar
Richard Littauer committed
35 36 37 38 39 40 41 42
## Security Issues

The IPFS protocol and its implementations are still in heavy development. This means that there may be problems in our protocols, or there may be mistakes in our implementations. And -- though IPFS is not production-ready yet -- many people are already running nodes in their machines. So we take security vulnerabilities very seriously. If you discover a security issue, please bring it to our attention right away!

If you find a vulnerability that may affect live deployments -- for example, by exposing a remote execution exploit -- please send your report privately to security@ipfs.io. Please DO NOT file a public issue.

If the issue is a protocol weakness that cannot be immediately exploited or something not yet deployed, just discuss it openly.

Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
43 44
## Install

Richard Littauer's avatar
Richard Littauer committed
45
The canonical download instructions for IPFS are over at: http://ipfs.io/docs/install/. It is **highly suggested** you follow those instructions if you are not interested in working on IPFS development.
Muneeb Ali's avatar
Muneeb Ali committed
46

Richard Littauer's avatar
Richard Littauer committed
47
### Install prebuilt packages
48

49
We host prebuilt binaries over at our [distributions page](https://dist.ipfs.io#go-ipfs).
50 51

From there:
52
- Click the blue "Download go-ipfs" on the right side of the page.
Richard Littauer's avatar
Richard Littauer committed
53
- Open/extract the archive.
54
- Move `ipfs` to your path (`install.sh` can do it for you).
55

Richard Littauer's avatar
Richard Littauer committed
56
### Build from Source
57

58
#### Prerequisite 1: Install Go
59

Richard Littauer's avatar
Richard Littauer committed
60
First, you'll need Go. If you don't have it: [Download Go 1.5.2+](https://golang.org/dl/).
61 62

You'll need to add Go's bin directories to your `$PATH` environment variable e.g., by adding these lines to your `/etc/profile` (for a system-wide installation) or `$HOME/.profile`:
Richard Littauer's avatar
Richard Littauer committed
63

Muneeb Ali's avatar
Muneeb Ali committed
64 65 66 67 68
```
export PATH=$PATH:/usr/local/go/bin
export PATH=$PATH:$GOPATH/bin
```

Richard Littauer's avatar
Richard Littauer committed
69
(If you run into trouble, see the [Go install instructions](https://golang.org/doc/install)).
70

71 72
#### Prerequisite 2: Install gx and gx-go

73
You can try using package manager, but gx and gx-go are unlikely to be available in repositories currently. The recommended way to install is to run `make toolkit_upgrade` before running `make install` in the next step.
74

Richard Littauer's avatar
Richard Littauer committed
75
#### Download + Compile IPFS
76

77
Simply run:
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
78 79

```
80 81 82
$ go get -d github.com/ipfs/go-ipfs
$ cd $GOPATH/src/github.com/ipfs/go-ipfs
$ make install
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
83 84
```

Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
85
NOTES:
86

Jeromy's avatar
Jeromy committed
87
* `git` is required in order for `go get` to fetch
88 89
all dependencies.
* Package managers often contain out-of-date `golang` packages.
Jeromy's avatar
Jeromy committed
90
  Ensure that `go version` reports at least 1.5.2. See above for how to install go.
91
* If you are interested in development, please install the development
Jeromy's avatar
Jeromy committed
92
dependencies as well.
Richard Littauer's avatar
Richard Littauer committed
93
* *WARNING: Older versions of OSX FUSE (for Mac OS X) can cause kernel panics when mounting!*
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
94
  We strongly recommend you use the [latest version of OSX FUSE](http://osxfuse.github.io/).
95
  (See https://github.com/ipfs/go-ipfs/issues/177)
Richard Littauer's avatar
Richard Littauer committed
96
* For more details on setting up FUSE (so that you can mount the filesystem), see the docs folder.
97
* Shell command completion is available in `misc/completion/ipfs-completion.bash`. Read [docs/command-completion.md](docs/command-completion.md) to learn how to install it.
98
* See the [init examples](https://github.com/ipfs/examples/tree/master/examples/init) for how to connect IPFS to systemd or whatever init system your distro uses.
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
99

Richard Littauer's avatar
Richard Littauer committed
100 101 102 103 104 105 106 107
### Development Dependencies

If you make changes to the protocol buffers, you will need to install the [protoc compiler](https://github.com/google/protobuf).

## Updating
IPFS has an updating tool that can be accessed through `ipfs update`. The tool is
not installed alongside IPFS in order to keep that logic independent of the main
codebase. To install `ipfs update`, either [download it here](https://gobuilder.me/github.com/ipfs/ipfs-update)
Jeromy's avatar
Jeromy committed
108
or install it from source with `go get -u github.com/ipfs/ipfs-update`.
Chas Leichner's avatar
Chas Leichner committed
109

Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
110 111 112
## Usage

```
drathir's avatar
drathir committed
113 114
USAGE:

115 116 117 118
    ipfs - global p2p merkle-dag filesystem

    ipfs [<flags>] <command> [<arg>] ...

drathir's avatar
drathir committed
119
    BASIC COMMANDS
120

121
        init          Initialize ipfs local configuration
Richard Littauer's avatar
Richard Littauer committed
122
        add <path>    Add an object to ipfs
123
        cat <ref>     Show ipfs object data
drathir's avatar
drathir committed
124
        get <ref>     Download ipfs objects
125
        ls <ref>      List links from an object
drathir's avatar
drathir committed
126
        refs <ref>    List hashes of links from an object
127

drathir's avatar
drathir committed
128
    DATA STRUCTURE COMMANDS
129

drathir's avatar
drathir committed
130 131 132
        block         Interact with raw blocks in the datastore
        object        Interact with raw dag nodes
        file          Interact with Unix filesystem objects
133

drathir's avatar
drathir committed
134
    ADVANCED COMMANDS
135

136 137
        daemon        Start a long-running daemon process
        mount         Mount an ipfs read-only mountpoint
drathir's avatar
drathir committed
138 139 140 141 142
        resolve       Resolve any type of name
        name          Publish or resolve IPNS names
        dns           Resolve DNS links
        pin           Pin objects to local storage
        repo gc       Garbage collect unpinned objects
143

drathir's avatar
drathir committed
144
    NETWORK COMMANDS
145

drathir's avatar
drathir committed
146 147 148
        id            Show info about ipfs peers
        bootstrap     Add or remove bootstrap peers
        swarm         Manage connections to the p2p network
Richard Littauer's avatar
Richard Littauer committed
149
        dht           Query the DHT for values or peers
drathir's avatar
drathir committed
150
        ping          Measure the latency of a connection
151
        diag          Print diagnostics
152

drathir's avatar
drathir committed
153
    TOOL COMMANDS
154

drathir's avatar
drathir committed
155 156 157 158
        config        Manage configuration
        version       Show ipfs version information
        update        Download and apply go-ipfs updates
        commands      List all available commands
159

drathir's avatar
drathir committed
160
    Use 'ipfs <command> --help' to learn more about each command.
161 162


Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
163
```
164

165
## Getting Started
166 167 168

See also: http://ipfs.io/docs/getting-started/

Richard Littauer's avatar
Richard Littauer committed
169
To start using IPFS, you must first initialize IPFS's config files on your
170
system, this is done with `ipfs init`. See `ipfs init --help` for information on
Jeromy's avatar
Jeromy committed
171 172
the optional arguments it takes. After initialization is complete, you can use
`ipfs mount`, `ipfs add` and any of the other commands to explore!
173

Jeromy's avatar
Jeromy committed
174 175 176 177 178 179 180 181 182
### Some things to try

Basic proof of 'ipfs working' locally:

	echo "hello world" > hello
	ipfs add hello
	# This should output a hash string that looks something like:
	# QmT78zSuBmuS4z925WZfrqQ1qHaJ56DQaTfyMUF7F8ff5o
	ipfs cat <that hash>
183

Jeromy's avatar
Jeromy committed
184

185 186
### Docker usage

187
An IPFS docker image is hosted at [hub.docker.com/r/ipfs/go-ipfs](https://hub.docker.com/r/ipfs/go-ipfs/).
188
To make files visible inside the container you need to mount a host directory
189
with the `-v` option to docker. Choose a directory that you want to use to
Richard Littauer's avatar
Richard Littauer committed
190 191
import/export files from IPFS. You should also choose a directory to store
IPFS files that will persist when you restart the container.
192 193 194

    export ipfs_staging=</absolute/path/to/somewhere/>
    export ipfs_data=</absolute/path/to/somewhere_else/>
Richard Littauer's avatar
Richard Littauer committed
195

196
Make sure docker can access these folders:
197 198 199

    sudo chmod -R 777 /absolute/path/to/somewhere/
    sudo chmod -R 777 /absolute/path/to/somewhere_else/
200

201 202
Start a container running ipfs and expose ports 4001, 5001 and 8080:

203
    docker run -d --name ipfs_host -v $ipfs_staging:/export -v $ipfs_data:/data/ipfs -p 8080:8080 -p 4001:4001 -p 5001:5001 ipfs/go-ipfs:latest
204

Michael Lovci's avatar
Michael Lovci committed
205 206 207
Watch the ipfs log:

    docker logs -f ipfs_host
208

209 210 211
Wait for ipfs to start. ipfs is running when you see:

    Gateway (readonly) server
Michael Lovci's avatar
Michael Lovci committed
212
    listening on /ip4/0.0.0.0/tcp/8080
213

Richard Littauer's avatar
Richard Littauer committed
214
You can now stop watching the log.
215

216 217 218 219 220
Run ipfs commands:

    docker exec ipfs_host ipfs <args...>

For example: connect to peers
221

222
    docker exec ipfs_host ipfs swarm peers
223

224 225 226 227
Add files:

    cp -r <something> $ipfs_staging
    docker exec ipfs_host ipfs add -r /export/<something>
228

229 230 231
Stop the running container:

    docker stop ipfs_host
232

233 234
#### Docker usage with VirtualBox/boot2docker (OSX and Windows)

235
Since docker is running in the boot2docker VM, you need to forward
Richard Littauer's avatar
Richard Littauer committed
236
relevant ports from the VM to your host for IPFS to act normally. This is
237 238 239 240
accomplished with the following command:

    boot2docker ssh -L 5001:localhost:5001 -L 4001:localhost:4001 -L 8080:localhost:8080 -fN

Jeromy's avatar
Jeromy committed
241
### Troubleshooting
Richard Littauer's avatar
Richard Littauer committed
242
If you have previously installed IPFS before and you are running into
Jeromy's avatar
Jeromy committed
243
problems getting a newer version to work, try deleting (or backing up somewhere
Richard Littauer's avatar
Richard Littauer committed
244
else) your IPFS config directory (~/.ipfs by default) and rerunning `ipfs init`.
Jeromy's avatar
Jeromy committed
245 246
This will reinitialize the config file to its defaults and clear out the local
datastore of any bad entries.
247

248
For any other problems, check the [issues list](https://github.com/ipfs/go-ipfs/issues)
Jeromy's avatar
Jeromy committed
249 250 251
and if you dont see your problem there, either come talk to us on irc (freenode #ipfs) or
file an issue of your own!

252 253
## Contributing

Richard Littauer's avatar
Richard Littauer committed
254
Please see [Contribute.md](contribute.md)!
255

256 257
## Todo

Richard Littauer's avatar
Richard Littauer committed
258
An IPFS alpha version has been released in February 2015. Things left to be done are all marked as [issues](https://github.com/ipfs/go-ipfs/issues).
259 260 261 262

## License

MIT