PyCon Italy 2014 ArbitrioFilosi ReNette a webservice for network reproducibility analysis

Here we introduce a novel Django based webservice for differential network analysis In order to manage extensive scientific computation tasks we design a distributed system where the computation part is independent from the frontend In particular the complex heterogeneous system is based on the integration of python R for scientific computing and Django Celery and RabbitMQ for web interface and asynchronous tasks management The algorithms are written in R and integrated as python class through Rpy2 module Each algorithm is mapped on a celery task which handles the communication between the webinterface and the computing server Jobs are submitted from the web frontend to the middleware using standard HTML forms and class based Django views Celery daemon manages the communication between the running process on the server and the web interface In particular it provides a queue which prioritize the submission of new jobs according to the load average of the machine Thanks to the distributed task queue system provided by the Celery daemon the application is easily scalable in order to meet the need of more power in case a high number of processes are asked to be computed by the server Once the process has finished the user is automatically redirected on the results webpage which returns the status of the process and a synthetic view of the submitted task Methods Implementation The service is based on the Django Model View Controller MVC framework with Python version 27 which interacts with the core process through the celery distributed task queue The application server was built with Apache2 web server integrated with uWSGI which allows configuration on high performance computing The core of the service is based on the Rpy2 interface which interacts with the R package nettools The double layer architecture is distributed on two machines one is the web frontend which manages data communication between clients and the computing system Frontend Red Hat Enterprise Linux Workstation release 65 with kernel 2632 virtual machine with 1 core 2GB of RAM running on vmware sphere The environment is based on Python 27 and Django 161 Backend Red Hat Enterprise Linux Workstation release 65 with kernel 2632 phisical machine based on a 24 cores 72 GB of RAM and 1TB of storage machine georun The current version 18 needs Python 27 Rpy2 230 Celery 317 R 302 nettools 095 igraph 066 to run correctly The website is available at httpsrenettefbkeu to install the system a complete list of the dependencies can be found on the github page httpsgithubcomMPBArenette,

#