Skip to content
Snippets Groups Projects
README.md 3.91 KiB
Newer Older
Francesco Siddi's avatar
Francesco Siddi committed
# Flamenco 2.0
Francesco Siddi's avatar
Francesco Siddi committed

Development repo for Flamenco 2.0 (originally known as brender). Flamenco is a
Free and Open Source Job distribution system for render farms.
Francesco Siddi's avatar
Francesco Siddi committed

Francesco Siddi's avatar
Francesco Siddi committed
Warning: currently Flamenco is in beta stage, testing welcome!

## Developer installation
Francesco Siddi's avatar
Francesco Siddi committed
In order to install Flamenco, we recommend to set up a Python virtual environment.

```
$ sudo easy_install virtualenv
```
fsiddi's avatar
fsiddi committed

fsiddi's avatar
fsiddi committed
On Linux this might work better:

```
$ sudo apt-get install python-virtualenv
```
Francesco Siddi's avatar
Francesco Siddi committed
Once you have virtualenv installed, just fire up a shell and create your own environment. You may want to create this folder inside of the Flamenco folder:
Francesco Siddi's avatar
Francesco Siddi committed
$ cd Flamenco
$ virtualenv venv
New python executable in venv/bin/python
Installing distribute............done.
```

Now, whenever you want to work on a project, you only have to activate the
corresponding environment. On OS X and Linux, do the following:

```
$ . venv/bin/activate
```

Now you can just enter the following command to get Flask activated in your
virtualenv:
Kelvin Jones's avatar
Kelvin Jones committed
## Core dependencies

The project has been developed for `python2.7`. We will move to `python3`
eventually.
Matthieu Simon's avatar
Matthieu Simon committed

On Unix systems, to install python dependencies, you may need to install
`python-dev` package.
Matthieu Simon's avatar
Matthieu Simon committed

Francesco Siddi's avatar
Francesco Siddi committed
On OSX, in order to prevent some warnings, you might need to run:
fsiddi's avatar
fsiddi committed
$ ARCHFLAGS=-Wno-error=unused-command-line-argument-hard-error-in-future
Anuga's avatar
Anuga committed

fsiddi's avatar
fsiddi committed
Then we just install all the packages required (run this on all systems)
Anuga's avatar
Anuga committed

```
fsiddi's avatar
fsiddi committed
$ pip install -r requirements.txt
Anuga's avatar
Anuga committed
```

Francesco Siddi's avatar
Francesco Siddi committed
Databases are managed by `MySQL` or `SQLite` (for testing only, don't use in production).
Matthieu Simon's avatar
Matthieu Simon committed

### Grunt file for the Dashboard
In order to streamline UI development of the Dashboard, we use Jade templating
and Sass for the CSS generation. In oder to generate the templates and CSS needed
by the dashboard, you need to install [NodeJS](https://nodejs.org/en/) and run
the following commands.

#### OSX
```
cd flamenco/dashboard
npm install -g grunt-cli
npm install
grunt
```

#### Debian Linux
On linux you can install NodeJS using the package manager.
```
cd flamenco/dashboard
echo "deb http://ftp.us.debian.org/debian wheezy-backports main" >> /etc/apt/sources.list
apt-get update
apt-get install nodejs nodejs-legacy curl
curl -L --insecure https://www.npmjs.org/install.sh | bash
npm install -g grunt-cli
apt-get install ruby
gem install sass
npm install
grunt
```

Francesco Siddi's avatar
Francesco Siddi committed
## Running Flamenco
It's pretty simple. Move into each folder (dashboard, server, manager or worker)
and run:
fsiddi's avatar
fsiddi committed

```
Francesco Siddi's avatar
Francesco Siddi committed
$ ./manage.py runserver # will start the different components
fsiddi's avatar
fsiddi committed
```
Francesco Siddi's avatar
Francesco Siddi committed

When running this command for the Manager for the first time, you will be
prompted for some configuration parameters.
If you now visit `http://localhost:8888` with your web browser you should see the dashboard!
fsiddi's avatar
fsiddi committed

Francesco Siddi's avatar
Francesco Siddi committed
It is also possible to configure the different applications. You may find a `config.py.example`, so you can rename it to `config.py` and edit it before run the application.
Matthieu Simon's avatar
Matthieu Simon committed

Francesco Siddi's avatar
Francesco Siddi committed
## Architecture
Francesco Siddi's avatar
Francesco Siddi committed
The important subfolders are:
* `server` containing the server files
* `worker` containing the worker files (render nodes)
Matthieu Simon's avatar
Matthieu Simon committed
* `manager` containing the manager files (manage clusters)
* `dashboard` containing the dashboard (web interface to talk to the server)
Francesco Siddi's avatar
Francesco Siddi committed

This structure explains also the naming conventions adopted to distinguish the
different parts of Flamenco.
Each folder contains an individual Flask application (except for the worker).
Server, Manager and Worker exchange JSON formatted messages between each other
via a REST API.
Olivier Amrein's avatar
Olivier Amrein committed
Dashboard connects to the Server only and accepts connections from clients (Browsers).
Francesco Siddi's avatar
Francesco Siddi committed

fsiddi's avatar
fsiddi committed

fsiddi's avatar
fsiddi committed
### About the web interface
Frameworks and tools used by the interface are:

* jQuery
fsiddi's avatar
fsiddi committed
* Bootstrap
fsiddi's avatar
fsiddi committed

Francesco Siddi's avatar
Francesco Siddi committed
### User and Developer documentation

The documentation is built with Sphinx and uses the readthedocs.org theme, so
make sure you have it installed. Instructions are available here:
Francesco Siddi's avatar
Francesco Siddi committed

`https://github.com/snide/sphinx_rtd_theme`

The `_build` contains the locally compiled documentation, which does not need
to be committed to the branch.