README.md 10.2 KB
Newer Older
Richard Littauer's avatar
Richard Littauer committed
1
# IPFS implementation in Go
2
[![GoDoc](https://godoc.org/github.com/ipfs/go-ipfs?status.svg)](https://godoc.org/github.com/ipfs/go-ipfs) [![Build Status](https://travis-ci.org/ipfs/go-ipfs.svg?branch=master)](https://travis-ci.org/ipfs/go-ipfs)
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
3

Richard Littauer's avatar
Richard Littauer committed
4
IPFS is a global, versioned, peer-to-peer filesystem. It combines good ideas from
Jeromy's avatar
Jeromy committed
5 6 7 8
Git, BitTorrent, Kademlia, SFS, and the Web. It is like a single bittorrent swarm,
exchanging git objects. IPFS provides an interface as simple as the HTTP web, but
with permanence built in. You can also mount the world at /ipfs.

Richard Littauer's avatar
Richard Littauer committed
9
For more info see: https://github.com/ipfs/ipfs.
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
10 11

Please put all issues regarding IPFS _design_ in the
12
[ipfs repo issues](https://github.com/ipfs/ipfs/issues).
Richard Littauer's avatar
Richard Littauer committed
13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33
Please put all issues regarding Go IPFS _implementation_ in [this repo](https://github.com/ipfs/go-ipfs/issues).

## Table of Contents

- [Security Issues](#security-issues)
- [Install](#install)
  - [Install prebuilt packages](#install-prebuilt-packages)
  - [Build from Source](#build-from-source)
  - [Prerequisite: Install Go](#prerequisite-install-go)
  - [Download + Compile IPFS](#download--compile-ipfs)
  - [Development Dependencies](#development-dependencies)
- [Updating](#updating)
- [Usage](#usage)
- [Getting Started](#getting-started)
  - [Some things to try](#some-things-to-try)
  - [Docker usage](#docker-usage)
    - [Docker usage with VirtualBox/boot2docker (OSX and Windows)](#docker-usage-with-virtualboxboot2docker-osx-and-windows)
- [Troubleshooting](#troubleshooting)
- [Contributing](#contributing)
- [Todo](#todo)
- [License](#license)
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
34

Richard Littauer's avatar
Richard Littauer committed
35 36 37 38 39 40 41 42
## Security Issues

The IPFS protocol and its implementations are still in heavy development. This means that there may be problems in our protocols, or there may be mistakes in our implementations. And -- though IPFS is not production-ready yet -- many people are already running nodes in their machines. So we take security vulnerabilities very seriously. If you discover a security issue, please bring it to our attention right away!

If you find a vulnerability that may affect live deployments -- for example, by exposing a remote execution exploit -- please send your report privately to security@ipfs.io. Please DO NOT file a public issue.

If the issue is a protocol weakness that cannot be immediately exploited or something not yet deployed, just discuss it openly.

Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
43 44
## Install

Richard Littauer's avatar
Richard Littauer committed
45
The canonical download instructions for IPFS are over at: http://ipfs.io/docs/install/. It is **highly suggested** you follow those instructions if you are not interested in working on IPFS development.
Muneeb Ali's avatar
Muneeb Ali committed
46

Richard Littauer's avatar
Richard Littauer committed
47
### Install prebuilt packages
48 49 50 51 52 53 54 55 56

We use [gobuilder.me](https://gobuilder.me), a great service that automatically builds a release on every commit.

You can see the latest builds for your platform at these links:

- [`release` - the last released version](https://gobuilder.me/github.com/ipfs/go-ipfs/cmd/ipfs?branch=release)  **<-- recommended**
- [`master` - development, stable](https://gobuilder.me/github.com/ipfs/go-ipfs/cmd/ipfs?branch=master)

From there:
Richard Littauer's avatar
Richard Littauer committed
57 58 59
- Click "Download" on the build for your platform.
- Open/extract the archive.
- Move `ipfs` to your path (`install.sh` can do it for you),
60

Richard Littauer's avatar
Richard Littauer committed
61
### Build from Source
62

Richard Littauer's avatar
Richard Littauer committed
63
#### Prerequisite: Install Go
64

Richard Littauer's avatar
Richard Littauer committed
65
First, you'll need Go. If you don't have it: [Download Go 1.5.2+](https://golang.org/dl/).
66 67

You'll need to add Go's bin directories to your `$PATH` environment variable e.g., by adding these lines to your `/etc/profile` (for a system-wide installation) or `$HOME/.profile`:
Richard Littauer's avatar
Richard Littauer committed
68

Muneeb Ali's avatar
Muneeb Ali committed
69 70 71 72 73
```
export PATH=$PATH:/usr/local/go/bin
export PATH=$PATH:$GOPATH/bin
```

Richard Littauer's avatar
Richard Littauer committed
74
(If you run into trouble, see the [Go install instructions](https://golang.org/doc/install)).
75

Richard Littauer's avatar
Richard Littauer committed
76
#### Download + Compile IPFS
77

78
Then:
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
79 80

```
81 82 83
$ go get -d github.com/ipfs/go-ipfs
$ cd $GOPATH/src/github.com/ipfs/go-ipfs
$ make install
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
84 85
```

86 87 88 89 90 91 92
Tip:

If the `make install` hangs while fetching dependencies, ensure that if you are
running a daemon locally, that it is on at least version 0.4.0-dev. If you don't
have a build that is new enough, run the make install with your daemon turned off
and the deps will be fetched through the ipfs.io gateways.

Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
93
NOTES:
94

Jeromy's avatar
Jeromy committed
95
* `git` is required in order for `go get` to fetch
96 97 98 99
all dependencies.
* Package managers often contain out-of-date `golang` packages.
  Compilation from source is recommended.
* If you are interested in development, please install the development
Jeromy's avatar
Jeromy committed
100
dependencies as well.
Richard Littauer's avatar
Richard Littauer committed
101
* *WARNING: Older versions of OSX FUSE (for Mac OS X) can cause kernel panics when mounting!*
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
102
  We strongly recommend you use the [latest version of OSX FUSE](http://osxfuse.github.io/).
103
  (See https://github.com/ipfs/go-ipfs/issues/177)
Richard Littauer's avatar
Richard Littauer committed
104
* For more details on setting up FUSE (so that you can mount the filesystem), see the docs folder.
105
* Shell command completion is available in `misc/completion/ipfs-completion.bash`. Read [docs/command-completion.md](docs/command-completion.md) to learn how to install it.
106
* See the [init examples](https://github.com/ipfs/examples/tree/master/examples/init) for how to connect IPFS to systemd or whatever init system your distro uses.
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
107

Richard Littauer's avatar
Richard Littauer committed
108 109 110 111 112 113 114 115
### Development Dependencies

If you make changes to the protocol buffers, you will need to install the [protoc compiler](https://github.com/google/protobuf).

## Updating
IPFS has an updating tool that can be accessed through `ipfs update`. The tool is
not installed alongside IPFS in order to keep that logic independent of the main
codebase. To install `ipfs update`, either [download it here](https://gobuilder.me/github.com/ipfs/ipfs-update)
Jeromy's avatar
Jeromy committed
116
or install it from source with `go get -u github.com/ipfs/ipfs-update`.
Chas Leichner's avatar
Chas Leichner committed
117

Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
118 119 120
## Usage

```
drathir's avatar
drathir committed
121 122
USAGE:

123 124 125 126
    ipfs - global p2p merkle-dag filesystem

    ipfs [<flags>] <command> [<arg>] ...

drathir's avatar
drathir committed
127 128
    BASIC COMMANDS
    
129
        init          Initialize ipfs local configuration
Richard Littauer's avatar
Richard Littauer committed
130
        add <path>    Add an object to ipfs
131
        cat <ref>     Show ipfs object data
drathir's avatar
drathir committed
132
        get <ref>     Download ipfs objects
133
        ls <ref>      List links from an object
drathir's avatar
drathir committed
134 135 136 137 138 139 140 141 142 143
        refs <ref>    List hashes of links from an object
    
    DATA STRUCTURE COMMANDS
    
        block         Interact with raw blocks in the datastore
        object        Interact with raw dag nodes
        file          Interact with Unix filesystem objects
    
    ADVANCED COMMANDS
    
144 145
        daemon        Start a long-running daemon process
        mount         Mount an ipfs read-only mountpoint
drathir's avatar
drathir committed
146 147 148 149 150 151 152 153 154 155 156 157 158
        resolve       Resolve any type of name
        name          Publish or resolve IPNS names
        dns           Resolve DNS links
        pin           Pin objects to local storage
        repo gc       Garbage collect unpinned objects
    
    NETWORK COMMANDS
    
        id            Show info about ipfs peers
        bootstrap     Add or remove bootstrap peers
        swarm         Manage connections to the p2p network
        dht           Query the dht for values or peers
        ping          Measure the latency of a connection
159
        diag          Print diagnostics
drathir's avatar
drathir committed
160 161 162 163 164 165 166 167 168
    
    TOOL COMMANDS
    
        config        Manage configuration
        version       Show ipfs version information
        update        Download and apply go-ipfs updates
        commands      List all available commands
    
    Use 'ipfs <command> --help' to learn more about each command.
169 170


Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
171
```
172

173
## Getting Started
174 175 176

See also: http://ipfs.io/docs/getting-started/

Richard Littauer's avatar
Richard Littauer committed
177
To start using IPFS, you must first initialize IPFS's config files on your
178
system, this is done with `ipfs init`. See `ipfs init --help` for information on
Jeromy's avatar
Jeromy committed
179 180
the optional arguments it takes. After initialization is complete, you can use
`ipfs mount`, `ipfs add` and any of the other commands to explore!
181

Jeromy's avatar
Jeromy committed
182 183 184 185 186 187 188 189 190
### Some things to try

Basic proof of 'ipfs working' locally:

	echo "hello world" > hello
	ipfs add hello
	# This should output a hash string that looks something like:
	# QmT78zSuBmuS4z925WZfrqQ1qHaJ56DQaTfyMUF7F8ff5o
	ipfs cat <that hash>
191

Jeromy's avatar
Jeromy committed
192

193 194
### Docker usage

Richard Littauer's avatar
Richard Littauer committed
195
An IPFS docker image is hosted at [hub.docker.com/r/jbenet/go-ipfs](https://hub.docker.com/r/jbenet/go-ipfs/).
196
To make files visible inside the container you need to mount a host directory
197
with the `-v` option to docker. Choose a directory that you want to use to
Richard Littauer's avatar
Richard Littauer committed
198 199
import/export files from IPFS. You should also choose a directory to store
IPFS files that will persist when you restart the container.
200 201 202

    export ipfs_staging=</absolute/path/to/somewhere/>
    export ipfs_data=</absolute/path/to/somewhere_else/>
Richard Littauer's avatar
Richard Littauer committed
203

204
Make sure docker can access these folders:
205 206 207

    sudo chmod -R 777 /absolute/path/to/somewhere/
    sudo chmod -R 777 /absolute/path/to/somewhere_else/
208

209 210
Start a container running ipfs and expose ports 4001, 5001 and 8080:

211
    docker run -d --name ipfs_host -v $ipfs_staging:/export -v $ipfs_data:/data/ipfs -p 8080:8080 -p 4001:4001 -p 5001:5001 jbenet/go-ipfs:latest
212

Michael Lovci's avatar
Michael Lovci committed
213 214 215
Watch the ipfs log:

    docker logs -f ipfs_host
216

217 218 219
Wait for ipfs to start. ipfs is running when you see:

    Gateway (readonly) server
Michael Lovci's avatar
Michael Lovci committed
220
    listening on /ip4/0.0.0.0/tcp/8080
221

Richard Littauer's avatar
Richard Littauer committed
222
You can now stop watching the log.
223

224 225 226 227 228
Run ipfs commands:

    docker exec ipfs_host ipfs <args...>

For example: connect to peers
229

230
    docker exec ipfs_host ipfs swarm peers
231

232 233 234 235
Add files:

    cp -r <something> $ipfs_staging
    docker exec ipfs_host ipfs add -r /export/<something>
236

237 238 239
Stop the running container:

    docker stop ipfs_host
240

241 242
#### Docker usage with VirtualBox/boot2docker (OSX and Windows)

243
Since docker is running in the boot2docker VM, you need to forward
Richard Littauer's avatar
Richard Littauer committed
244
relevant ports from the VM to your host for IPFS to act normally. This is
245 246 247 248
accomplished with the following command:

    boot2docker ssh -L 5001:localhost:5001 -L 4001:localhost:4001 -L 8080:localhost:8080 -fN

Jeromy's avatar
Jeromy committed
249
### Troubleshooting
Richard Littauer's avatar
Richard Littauer committed
250
If you have previously installed IPFS before and you are running into
Jeromy's avatar
Jeromy committed
251
problems getting a newer version to work, try deleting (or backing up somewhere
Richard Littauer's avatar
Richard Littauer committed
252
else) your IPFS config directory (~/.ipfs by default) and rerunning `ipfs init`.
Jeromy's avatar
Jeromy committed
253 254
This will reinitialize the config file to its defaults and clear out the local
datastore of any bad entries.
255

256
For any other problems, check the [issues list](https://github.com/ipfs/go-ipfs/issues)
Jeromy's avatar
Jeromy committed
257 258 259
and if you dont see your problem there, either come talk to us on irc (freenode #ipfs) or
file an issue of your own!

260 261
## Contributing

Richard Littauer's avatar
Richard Littauer committed
262
Please see [Contribute.md](contribute.md)!
263

264 265
## Todo

Richard Littauer's avatar
Richard Littauer committed
266
An IPFS alpha version has been released in February 2015. Things left to be done are all marked as [issues](https://github.com/ipfs/go-ipfs/issues).
267 268 269 270

## License

MIT