Administration¶
This is a page for Administrators who wish to offer hanythingondemand on their PBS/Torque cluster. hanythingondemand is a particularly tricky project as it integrates several pieces of tecchnology (Torque, MPI, Java, Hadoop, on Python) and as such we don’t have an out of the box installation procedure yet.
Prerequisites¶
Here’s an overview of the dependencies:
- A cluster using Torque
- environment-modules (used to test HOD) to manage the environment
- Python - 2.7.*
- Easybuild - we use Easybuild for installing software and hanythingondemand isn’t tested without it.
- mpi4py
- vsc-base - Used for command line parsing.
- vsc-mympirun - Used for setting up the MPI job.
- pbs_python - Used for interacting with the PBS (aka Torque) server.
- Netifaces
- Netaddr
- Java
- Hadoop binaries
Torque¶
To use hanythingondemand you must be running a cluster that uses Torque as the resource manager.
Environment Modules¶
We use environment modules in conjunction with EasyBuild. You do not require environment-modules, however you will need to sort out all the paths for your users if you elect to not use it.
Easybuild¶
The following dependencies are installable using Easybuild. They should be pulled in when using the eb hanythingondemand-${VERSION}.eb --robot command:
Java¶
We use the Oracle JVM which isn’t directly installable from EasyBuild since you need to register on the website to get the files.
Note
You’ll need to manually download the JDK tarballs (requires registration) and seed them to EasyBuild.