README.md 9.01 KB
Newer Older
Jeromy's avatar
Jeromy committed
1
# ipfs implementation in go.
2
[![GoDoc](https://godoc.org/github.com/ipfs/go-ipfs?status.svg)](https://godoc.org/github.com/ipfs/go-ipfs) [![Build Status](https://travis-ci.org/ipfs/go-ipfs.svg?branch=master)](https://travis-ci.org/ipfs/go-ipfs)
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
3

Jeromy's avatar
Jeromy committed
4 5 6 7 8
Ipfs is a global, versioned, peer-to-peer filesystem. It combines good ideas from
Git, BitTorrent, Kademlia, SFS, and the Web. It is like a single bittorrent swarm,
exchanging git objects. IPFS provides an interface as simple as the HTTP web, but
with permanence built in. You can also mount the world at /ipfs.

9
For more info see: https://github.com/ipfs/ipfs
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
10 11

Please put all issues regarding IPFS _design_ in the
12 13
[ipfs repo issues](https://github.com/ipfs/ipfs/issues).
Please put all issues regarding go IPFS _implementation_ in [this repo](https://github.com/ipfs/go-ipfs/issues).
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
14

Richard Littauer's avatar
Richard Littauer committed
15 16 17 18 19 20 21 22
## Security Issues

The IPFS protocol and its implementations are still in heavy development. This means that there may be problems in our protocols, or there may be mistakes in our implementations. And -- though IPFS is not production-ready yet -- many people are already running nodes in their machines. So we take security vulnerabilities very seriously. If you discover a security issue, please bring it to our attention right away!

If you find a vulnerability that may affect live deployments -- for example, by exposing a remote execution exploit -- please send your report privately to security@ipfs.io. Please DO NOT file a public issue.

If the issue is a protocol weakness that cannot be immediately exploited or something not yet deployed, just discuss it openly.

Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
23 24
## Install

25
The canonical download instructions for IPFS are over at: http://ipfs.io/docs/install/
Muneeb Ali's avatar
Muneeb Ali committed
26

27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45
## Install prebuilt packages

We use [gobuilder.me](https://gobuilder.me), a great service that automatically builds a release on every commit.

You can see the latest builds for your platform at these links:

- [`release` - the last released version](https://gobuilder.me/github.com/ipfs/go-ipfs/cmd/ipfs?branch=release)  **<-- recommended**
- [`master` - development, stable](https://gobuilder.me/github.com/ipfs/go-ipfs/cmd/ipfs?branch=master)

From there:
- click "Download" on the build for your platform
- open/extract the archive
- move `ipfs` to your path (`install.sh` can do it for you)


## Build from Source

### Prerequisite: Install Go

Jeromy's avatar
Jeromy committed
46
First, you'll need go. If you don't have it: [Download Go 1.5.2+](https://golang.org/dl/).
47 48

You'll need to add Go's bin directories to your `$PATH` environment variable e.g., by adding these lines to your `/etc/profile` (for a system-wide installation) or `$HOME/.profile`:
Muneeb Ali's avatar
Muneeb Ali committed
49 50 51 52 53
```
export PATH=$PATH:/usr/local/go/bin
export PATH=$PATH:$GOPATH/bin
```

54
(If you run into trouble, see the [Go install instructions](https://golang.org/doc/install))
55 56 57

### Download + Compile IPFS

Muneeb Ali's avatar
Muneeb Ali committed
58
Then simply:
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
59 60

```
61
go get -u github.com/ipfs/go-ipfs/cmd/ipfs
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
62 63
```

Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
64
NOTES:
65

Jeromy's avatar
Jeromy committed
66
* `git` is required in order for `go get` to fetch
67 68 69 70
all dependencies.
* Package managers often contain out-of-date `golang` packages.
  Compilation from source is recommended.
* If you are interested in development, please install the development
Jeromy's avatar
Jeromy committed
71
dependencies as well.
Jeromy's avatar
Jeromy committed
72
* *WARNING: older versions of OSX FUSE (for Mac OS X) can cause kernel panics when mounting!*
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
73
  We strongly recommend you use the [latest version of OSX FUSE](http://osxfuse.github.io/).
74
  (See https://github.com/ipfs/go-ipfs/issues/177)
75
* For more details on setting up FUSE (so that you can mount the filesystem), see the docs folder
76
* Shell command completion is available in `misc/completion/ipfs-completion.bash`. Read [docs/command-completion.md](docs/command-completion.md) to learn how to install it.
77
* See the [init examples](https://github.com/ipfs/examples/tree/master/examples/init) for how to connect IPFS to systemd or whatever init system your distro uses.
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
78

Jeromy's avatar
Jeromy committed
79 80
### Updating
ipfs has an updating tool that can be accessed through `ipfs update`. The tool is
Jeromy's avatar
Jeromy committed
81
not installed alongside ipfs in order to keep that logic independent of the main
Jeromy's avatar
Jeromy committed
82 83
codebase. To install ipfs update, either [download it here](https://gobuilder.me/github.com/ipfs/ipfs-update)
or install it from source with `go get -u github.com/ipfs/ipfs-update`.
Chas Leichner's avatar
Chas Leichner committed
84

Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
85 86 87
## Usage

```
drathir's avatar
drathir committed
88 89
USAGE:

90 91 92 93
    ipfs - global p2p merkle-dag filesystem

    ipfs [<flags>] <command> [<arg>] ...

drathir's avatar
drathir committed
94 95
    BASIC COMMANDS
    
96
        init          Initialize ipfs local configuration
Richard Littauer's avatar
Richard Littauer committed
97
        add <path>    Add a file to ipfs
98
        cat <ref>     Show ipfs object data
drathir's avatar
drathir committed
99
        get <ref>     Download ipfs objects
100
        ls <ref>      List links from an object
drathir's avatar
drathir committed
101 102 103 104 105 106 107 108 109 110
        refs <ref>    List hashes of links from an object
    
    DATA STRUCTURE COMMANDS
    
        block         Interact with raw blocks in the datastore
        object        Interact with raw dag nodes
        file          Interact with Unix filesystem objects
    
    ADVANCED COMMANDS
    
111 112
        daemon        Start a long-running daemon process
        mount         Mount an ipfs read-only mountpoint
drathir's avatar
drathir committed
113 114 115 116 117 118 119 120 121 122 123 124 125
        resolve       Resolve any type of name
        name          Publish or resolve IPNS names
        dns           Resolve DNS links
        pin           Pin objects to local storage
        repo gc       Garbage collect unpinned objects
    
    NETWORK COMMANDS
    
        id            Show info about ipfs peers
        bootstrap     Add or remove bootstrap peers
        swarm         Manage connections to the p2p network
        dht           Query the dht for values or peers
        ping          Measure the latency of a connection
126
        diag          Print diagnostics
drathir's avatar
drathir committed
127 128 129 130 131 132 133 134 135
    
    TOOL COMMANDS
    
        config        Manage configuration
        version       Show ipfs version information
        update        Download and apply go-ipfs updates
        commands      List all available commands
    
    Use 'ipfs <command> --help' to learn more about each command.
136 137


Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
138
```
139

140
## Getting Started
141 142 143

See also: http://ipfs.io/docs/getting-started/

Jeromy's avatar
Jeromy committed
144
To start using ipfs, you must first initialize ipfs's config files on your
145
system, this is done with `ipfs init`. See `ipfs init --help` for information on
Jeromy's avatar
Jeromy committed
146 147
the optional arguments it takes. After initialization is complete, you can use
`ipfs mount`, `ipfs add` and any of the other commands to explore!
148

Jeromy's avatar
Jeromy committed
149 150 151 152 153 154 155 156 157
### Some things to try

Basic proof of 'ipfs working' locally:

	echo "hello world" > hello
	ipfs add hello
	# This should output a hash string that looks something like:
	# QmT78zSuBmuS4z925WZfrqQ1qHaJ56DQaTfyMUF7F8ff5o
	ipfs cat <that hash>
158

Jeromy's avatar
Jeromy committed
159

160 161
### Docker usage

162
An ipfs docker image is hosted at [hub.docker.com/r/jbenet/go-ipfs](https://hub.docker.com/r/jbenet/go-ipfs/).
163
To make files visible inside the container you need to mount a host directory
164
with the `-v` option to docker. Choose a directory that you want to use to
165
import/export files from ipfs. You should also choose a directory to store
166 167 168 169
ipfs files that will persist when you restart the container.

    export ipfs_staging=</absolute/path/to/somewhere/>
    export ipfs_data=</absolute/path/to/somewhere_else/>
170
    
171
Make sure docker can access these folders:
172 173 174

    sudo chmod -R 777 /absolute/path/to/somewhere/
    sudo chmod -R 777 /absolute/path/to/somewhere_else/
175

176 177
Start a container running ipfs and expose ports 4001, 5001 and 8080:

178
    docker run -d --name ipfs_host -v $ipfs_staging:/export -v $ipfs_data:/data/ipfs -p 8080:8080 -p 4001:4001 -p 5001:5001 jbenet/go-ipfs:latest
179

Michael Lovci's avatar
Michael Lovci committed
180 181 182
Watch the ipfs log:

    docker logs -f ipfs_host
183

184 185 186
Wait for ipfs to start. ipfs is running when you see:

    Gateway (readonly) server
Michael Lovci's avatar
Michael Lovci committed
187
    listening on /ip4/0.0.0.0/tcp/8080
188

Michael Lovci's avatar
Michael Lovci committed
189
(you can now stop watching the log)
190

191 192 193 194 195
Run ipfs commands:

    docker exec ipfs_host ipfs <args...>

For example: connect to peers
196

197
    docker exec ipfs_host ipfs swarm peers
198

199 200 201 202 203

Add files:

    cp -r <something> $ipfs_staging
    docker exec ipfs_host ipfs add -r /export/<something>
204

205 206 207
Stop the running container:

    docker stop ipfs_host
208

209 210
#### Docker usage with VirtualBox/boot2docker (OSX and Windows)

211 212
Since docker is running in the boot2docker VM, you need to forward
relevant ports from the VM to your host for ipfs act normally. This is
213 214 215 216 217
accomplished with the following command:

    boot2docker ssh -L 5001:localhost:5001 -L 4001:localhost:4001 -L 8080:localhost:8080 -fN


Jeromy's avatar
Jeromy committed
218 219
### Troubleshooting
If you have previously installed ipfs before and you are running into
Jeromy's avatar
Jeromy committed
220
problems getting a newer version to work, try deleting (or backing up somewhere
221
else) your ipfs config directory (~/.ipfs by default) and rerunning `ipfs init`.
Jeromy's avatar
Jeromy committed
222 223
This will reinitialize the config file to its defaults and clear out the local
datastore of any bad entries.
224

225
For any other problems, check the [issues list](https://github.com/ipfs/go-ipfs/issues)
Jeromy's avatar
Jeromy committed
226 227 228
and if you dont see your problem there, either come talk to us on irc (freenode #ipfs) or
file an issue of your own!

229

230 231
## Contributing

Richard Littauer's avatar
Richard Littauer committed
232
Please see [Contribute.md](contribute.md)!
233

234 235
## Todo

236
An IPFS alpha version has been released in February 2015. Things left to be done are all marked as [Issues](https://github.com/ipfs/go-ipfs/issues)
237

Chas Leichner's avatar
Chas Leichner committed
238 239
## Development Dependencies

240
If you make changes to the protocol buffers, you will need to install the [protoc compiler](https://github.com/google/protobuf).
241 242 243 244

## License

MIT