Install instructions

(1) Install prerequisites. You can get pip from http://www.pip-installer.org/en/latest/ The apt-get commands used on ubuntu for non-Python prerequisites and the pip commands are:

apt-get install -y libxml2-dev libxslt-dev # lxml prereq
apt-get install -y g++ # scipy prereq
apt-get install -y gfortran # scipy prereq
apt-get install -y liblapack-dev # scipy prereq
apt-get install -y libpng-dev # matplotlib prereq
apt-get install -y libfreetype6-dev # matplotlib prereq
apt-get install -y libjpeg8-dev # matplotlib prereq
easy_install pyparsing==1.5.7
pip install --upgrade numpy
pip install --upgrade scipy
pip install --upgrade biopython
pip install --upgrade ipython
pip install --upgrade lxml
pip install --upgrade PIL
pip install --upgrade requests
pip install --upgrade matplotlib
pip install --upgrade pyenchant

This builds from source, make sure a fortran compiler is installed. May have problem where numpy doesn't load correctly and scipy install fails - try building numpy from github source.[PEM]

Alternately, the included requirements.txt file lists known-good versions of all the required python modules for phylografter and opentree, plus a few convenience modules. To install these modules using pip,

pip install -r requirements.txt

TODO: Add installation instructions for pyenchant and libenchant.

(2) Install MySQL.

I'm assuming below that it is installed in /usr/local/mysql. I used MySQL-5.5.27

(3) Configure SQL.

Create an SQL user ( 'tester' in our example)
Assign the user a password ('abc123' in our example)
Create an SQL database called something ('phylografter' in our example)
Give the user privileges to modify the database

 $ /usr/local/mysql/bin/mysql -u root --password=sqluserspassword
mysql> CREATE USER 'tester'@'localhost' IDENTIFIED BY 'abc123' ;
mysql> CREATE database phylografter ;
mysql> GRANT ALL ON phylografter.* to 'tester'@'localhost' ;
mysql> FLUSH PRIVILEGES;

(4) Configure Phylografter

Set the phylografter/private/config to contain:

[db]
host = localhost
user = tester
password = abc123
dbname = phylografter

(5) lxml [you probably already did this, see above]

pip install lxml

(6) Download and unpack the source code version of web2py from http://www.web2py.com/examples/default/download .

(7) Register phylografter as a web2py app by creating a symbolic link

cd web2py/applications
ln -s /full/path/to/phylografter .

where the phylografter directory above is the one where you found this README file.

(8) Bootstrap the DB tables for phylografter. Download new mysql dump from http://reelab.net/~rree/phylografter.sql.bz2 To load a SQL dump: launch the mysql daemon with large packet sizes:

sudo /usr/local/mysql/bin/mysqld_safe --max_allowed_pack=32M

curl "http://reelab.net/~rree/phylografter.sql.gz" >phylografter.sql.gz
gunzip -c phylografter.sql.gz | \
  /usr/local/mysql/bin/mysql --user=tester --password=abc123 --max_allowed_packet=300M --connect_timeout=6000 phylografter

This took 900 seconds (15 minutes) when I [JAR] did it on a 2011 MacBook Air.

(9) Launch web2py (you can use -a <recycle> to re-use the admin password):

python web2py.py --nogui -a '<recycle>'

(10) Direct a browser to http://127.0.0.1:8000/phylografter/stree/index (should display a "Source trees" table).

(11) Download the required files and setup information for the taxonomy graph tools here: https://github.com/OpenTreeOfLife/taxonomy-stree-json

Authorizing users to upload

You can authorize users to upload trees as follows:

1. From http://127.0.0.1:8000/admin/default/site
2. Under phylografter click 'Edit'
3. Under Models click 'database administration'
4. Under db.auth_membership click 'insert new auth_membership'
5. Choose your user and the 'contributor' group (id 3) and click submit

Experimental features

Support for 2nexml functionality, and discussion of launching external processes

If you add a section similar to:

[external]
dir = /tmp/phylografter_external_tools/
2nexml = /usr/local/bin/2nexml

to the private/config file, then you should be able to use the NEXUS to NeXML conversion facility. The "dir" setting in the "external" section specifies a directory on the filesystem that will be the parent of the scratch directory used when invoking external processes.

The "2nexml" setting in the "external" section is the absolute path of the 2nexml executable on the server's filesystem. Consult https://github.com/OpenTreeOfLife/2nexml for details on how to install the 2nexml tool.

The URL for invoking this controller is: DOMAIN/phylografter/study/to_nexml/ID where the ID is the filename that web2py generates for a file that is uploaded as part of a study. This is the same ID scheme used in the study/download/ID URLs, so this filename should be unique.

When the controller is invoked, phylografter will try to find a row in the study_file table that has a file field that matches the ID. If it finds this row, phylografter will trigger a newly implemented system for invoking an external process. In this case, it will invoke the 2nexml command-line tool.

NEXUS to NeXML conversion is typically fast, so the call to the external process blocks.