Vagrant

Vagrant uses an easy configurable workflow for automation of development environment setups. A list of available configurations for development boxes can be accessed at vagrantbox.es.

Following is a list of steps to get started with a multi-node cluster with Hadoop in minutes.

  1. Download and install the pre-requisites: Virtualbox and Vagrant.
  2. Run vagrant box add command with the link for the desired vagrant development box configuration.
  3. Download Hadoop, Spark and Java to local for speeding up installation. Alternatively, you could specify the remote URLs for downloading these software during installation.
  4. Run vagrant up to setup your development environment.
  5. Run vagrant ssh to access the environment and perform post-provisioning tasks like starting up Hadoop and Spark daemons.
Advertisements