hanythingondemand (HoD) documentation

Welcome to the documentation of hanythingondemand (HOD, for short), a tool to set up and use an ad-hoc Hadoop cluster on HPC systems through a cluster resource manager like Torque/PBS.

https://github.com/hpcugent/hanythingondemand

This documentation is intended for hanythingondemand version 3.2.0, and was last rebuilt on Tue, 30 May 2017 07:44:38.

Introductory topics

• What is hanythingondemand?
• Administration
  • Prerequisites
  • Torque
  • Environment Modules
• Configuration
  • Template parameters
  • Service configs
  • Autogenerated configuration
  • Preview configuration
• Command line interface
  • hod command
  • hod subcommands
• Logging
  • hanythingondemand logs
  • Service logs
• Connecting to web user interfaces
  • Setting up an SSH tunnel
  • Browser SOCKS proxy configuration
  • Ports for web user interfaces
• Spark
• Example use cases
  • Common aspects
  • Interactively using a Hadoop cluster
  • Running a batch script on a Hadoop cluster
  • Connecting to a Jupyter notebook running on an HOD cluster