README.md 8.67 KB
Newer Older
Jeromy's avatar
Jeromy committed
1
# ipfs implementation in go.
2
[![GoDoc](https://godoc.org/github.com/ipfs/go-ipfs?status.svg)](https://godoc.org/github.com/ipfs/go-ipfs) [![Build Status](https://travis-ci.org/ipfs/go-ipfs.svg?branch=master)](https://travis-ci.org/ipfs/go-ipfs)
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
3

Jeromy's avatar
Jeromy committed
4 5 6 7 8
Ipfs is a global, versioned, peer-to-peer filesystem. It combines good ideas from
Git, BitTorrent, Kademlia, SFS, and the Web. It is like a single bittorrent swarm,
exchanging git objects. IPFS provides an interface as simple as the HTTP web, but
with permanence built in. You can also mount the world at /ipfs.

9
For more info see: https://github.com/ipfs/ipfs
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
10 11

Please put all issues regarding IPFS _design_ in the
12 13
[ipfs repo issues](https://github.com/ipfs/ipfs/issues).
Please put all issues regarding go IPFS _implementation_ in [this repo](https://github.com/ipfs/go-ipfs/issues).
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
14

Richard Littauer's avatar
Richard Littauer committed
15 16 17 18 19 20 21 22
## Security Issues

The IPFS protocol and its implementations are still in heavy development. This means that there may be problems in our protocols, or there may be mistakes in our implementations. And -- though IPFS is not production-ready yet -- many people are already running nodes in their machines. So we take security vulnerabilities very seriously. If you discover a security issue, please bring it to our attention right away!

If you find a vulnerability that may affect live deployments -- for example, by exposing a remote execution exploit -- please send your report privately to security@ipfs.io. Please DO NOT file a public issue.

If the issue is a protocol weakness that cannot be immediately exploited or something not yet deployed, just discuss it openly.

Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
23 24
## Install

25
The canonical download instructions for IPFS are over at: http://ipfs.io/docs/install
Muneeb Ali's avatar
Muneeb Ali committed
26

27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45
## Install prebuilt packages

We use [gobuilder.me](https://gobuilder.me), a great service that automatically builds a release on every commit.

You can see the latest builds for your platform at these links:

- [`release` - the last released version](https://gobuilder.me/github.com/ipfs/go-ipfs/cmd/ipfs?branch=release)  **<-- recommended**
- [`master` - development, stable](https://gobuilder.me/github.com/ipfs/go-ipfs/cmd/ipfs?branch=master)

From there:
- click "Download" on the build for your platform
- open/extract the archive
- move `ipfs` to your path (`install.sh` can do it for you)


## Build from Source

### Prerequisite: Install Go

46
First, you'll need go. If you don't have it: [Download Go 1.5.1+](https://golang.org/dl/).
47 48

You'll need to add Go's bin directories to your `$PATH` environment variable e.g., by adding these lines to your `/etc/profile` (for a system-wide installation) or `$HOME/.profile`:
Muneeb Ali's avatar
Muneeb Ali committed
49 50 51 52 53
```
export PATH=$PATH:/usr/local/go/bin
export PATH=$PATH:$GOPATH/bin
```

54 55 56 57
(If you run into trouble, see the [Go install instructions](http://golang.org/doc/install))

### Download + Compile IPFS

Muneeb Ali's avatar
Muneeb Ali committed
58
Then simply:
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
59 60

```
61
go get -u github.com/ipfs/go-ipfs/cmd/ipfs
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
62 63
```

Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
64
NOTES:
65

Jeromy's avatar
Jeromy committed
66
* `git` is required in order for `go get` to fetch
67 68 69 70
all dependencies.
* Package managers often contain out-of-date `golang` packages.
  Compilation from source is recommended.
* If you are interested in development, please install the development
Jeromy's avatar
Jeromy committed
71
dependencies as well.
Jeromy's avatar
Jeromy committed
72
* *WARNING: older versions of OSX FUSE (for Mac OS X) can cause kernel panics when mounting!*
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
73
  We strongly recommend you use the [latest version of OSX FUSE](http://osxfuse.github.io/).
74
  (See https://github.com/ipfs/go-ipfs/issues/177)
75
* For more details on setting up FUSE (so that you can mount the filesystem), see the docs folder
76
* Shell command completion is available in `misc/completion/ipfs-completion.bash`. Read [docs/command-completion.md](docs/command-completion.md) to learn how to install it.
77
* See the [init examples](https://github.com/ipfs/examples/tree/master/examples/init) for how to connect IPFS to systemd or whatever init system your distro uses.
Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
78

Chas Leichner's avatar
Chas Leichner committed
79

Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
80 81 82
## Usage

```
drathir's avatar
drathir committed
83 84
USAGE:

85 86 87 88
    ipfs - global p2p merkle-dag filesystem

    ipfs [<flags>] <command> [<arg>] ...

drathir's avatar
drathir committed
89 90
    BASIC COMMANDS
    
91 92 93
        init          Initialize ipfs local configuration
        add <path>    Add an object to ipfs
        cat <ref>     Show ipfs object data
drathir's avatar
drathir committed
94
        get <ref>     Download ipfs objects
95
        ls <ref>      List links from an object
drathir's avatar
drathir committed
96 97 98 99 100 101 102 103 104 105
        refs <ref>    List hashes of links from an object
    
    DATA STRUCTURE COMMANDS
    
        block         Interact with raw blocks in the datastore
        object        Interact with raw dag nodes
        file          Interact with Unix filesystem objects
    
    ADVANCED COMMANDS
    
106 107
        daemon        Start a long-running daemon process
        mount         Mount an ipfs read-only mountpoint
drathir's avatar
drathir committed
108 109 110 111 112 113 114 115 116 117 118 119 120
        resolve       Resolve any type of name
        name          Publish or resolve IPNS names
        dns           Resolve DNS links
        pin           Pin objects to local storage
        repo gc       Garbage collect unpinned objects
    
    NETWORK COMMANDS
    
        id            Show info about ipfs peers
        bootstrap     Add or remove bootstrap peers
        swarm         Manage connections to the p2p network
        dht           Query the dht for values or peers
        ping          Measure the latency of a connection
121
        diag          Print diagnostics
drathir's avatar
drathir committed
122 123 124 125 126 127 128 129 130
    
    TOOL COMMANDS
    
        config        Manage configuration
        version       Show ipfs version information
        update        Download and apply go-ipfs updates
        commands      List all available commands
    
    Use 'ipfs <command> --help' to learn more about each command.
131 132


Juan Batiz-Benet's avatar
Juan Batiz-Benet committed
133
```
134

135
## Getting Started
136 137 138

See also: http://ipfs.io/docs/getting-started/

Jeromy's avatar
Jeromy committed
139
To start using ipfs, you must first initialize ipfs's config files on your
140
system, this is done with `ipfs init`. See `ipfs init --help` for information on
Jeromy's avatar
Jeromy committed
141 142
the optional arguments it takes. After initialization is complete, you can use
`ipfs mount`, `ipfs add` and any of the other commands to explore!
143

Jeromy's avatar
Jeromy committed
144 145 146 147 148 149 150 151 152
### Some things to try

Basic proof of 'ipfs working' locally:

	echo "hello world" > hello
	ipfs add hello
	# This should output a hash string that looks something like:
	# QmT78zSuBmuS4z925WZfrqQ1qHaJ56DQaTfyMUF7F8ff5o
	ipfs cat <that hash>
153

Jeromy's avatar
Jeromy committed
154

155 156
### Docker usage

Andres Buritica's avatar
Andres Buritica committed
157
An ipfs docker image is hosted at [hub.docker.com/r/jbenet/go-ipfs](http://hub.docker.com/r/jbenet/go-ipfs).
158
To make files visible inside the container you need to mount a host directory
159
with the `-v` option to docker. Choose a directory that you want to use to
160
import/export files from ipfs. You should also choose a directory to store
161 162 163 164
ipfs files that will persist when you restart the container.

    export ipfs_staging=</absolute/path/to/somewhere/>
    export ipfs_data=</absolute/path/to/somewhere_else/>
165
    
166
Make sure docker can access these folders:
167 168 169

    sudo chmod -R 777 /absolute/path/to/somewhere/
    sudo chmod -R 777 /absolute/path/to/somewhere_else/
170

171 172
Start a container running ipfs and expose ports 4001, 5001 and 8080:

173
    docker run -d --name ipfs_host -v $ipfs_staging:/export -v $ipfs_data:/data/ipfs -p 8080:8080 -p 4001:4001 -p 5001:5001 jbenet/go-ipfs:latest
174

Michael Lovci's avatar
Michael Lovci committed
175 176 177
Watch the ipfs log:

    docker logs -f ipfs_host
178

179 180 181
Wait for ipfs to start. ipfs is running when you see:

    Gateway (readonly) server
Michael Lovci's avatar
Michael Lovci committed
182
    listening on /ip4/0.0.0.0/tcp/8080
183

Michael Lovci's avatar
Michael Lovci committed
184
(you can now stop watching the log)
185

186 187 188 189 190
Run ipfs commands:

    docker exec ipfs_host ipfs <args...>

For example: connect to peers
191

192
    docker exec ipfs_host ipfs swarm peers
193

194 195 196 197 198

Add files:

    cp -r <something> $ipfs_staging
    docker exec ipfs_host ipfs add -r /export/<something>
199

200 201 202
Stop the running container:

    docker stop ipfs_host
203

204 205
#### Docker usage with VirtualBox/boot2docker (OSX and Windows)

206 207
Since docker is running in the boot2docker VM, you need to forward
relevant ports from the VM to your host for ipfs act normally. This is
208 209 210 211 212
accomplished with the following command:

    boot2docker ssh -L 5001:localhost:5001 -L 4001:localhost:4001 -L 8080:localhost:8080 -fN


Jeromy's avatar
Jeromy committed
213 214
### Troubleshooting
If you have previously installed ipfs before and you are running into
Jeromy's avatar
Jeromy committed
215
problems getting a newer version to work, try deleting (or backing up somewhere
216
else) your ipfs config directory (~/.ipfs by default) and rerunning `ipfs init`.
Jeromy's avatar
Jeromy committed
217 218
This will reinitialize the config file to its defaults and clear out the local
datastore of any bad entries.
219

220
For any other problems, check the [issues list](http://github.com/ipfs/go-ipfs/issues)
Jeromy's avatar
Jeromy committed
221 222 223
and if you dont see your problem there, either come talk to us on irc (freenode #ipfs) or
file an issue of your own!

224

225 226
## Contributing

Richard Littauer's avatar
Richard Littauer committed
227
Please see [Contribute.md](contribute.md)!
228

229 230
## Todo

231
An IPFS alpha version has been released in February 2015. Things left to be done are all marked as [Issues](https://github.com/ipfs/go-ipfs/issues)
232

Chas Leichner's avatar
Chas Leichner committed
233 234 235
## Development Dependencies

If you make changes to the protocol buffers, you will need to install the [protoc compiler](https://code.google.com/p/protobuf/downloads/list).
236 237 238 239

## License

MIT