FG Twister Appliance Tutorial¶

I. Introduction¶

Twister appliance on FutureGrid. |

II. Prerequisites¶

III. Deploying a grid appliance connected to your own pool using GroupVPN¶

To connect to any other GroupVPN pool, place a floppy disk containing the GroupVPN configuration files inside the appliance in the /opt/grid_appliance/etc directory and restart the grid appliance service. This floppy can be generated using the grid appliance.org web front-end. In the case of executing a private cluster for a Twister appliance, download the server and worker floppies. Designate one node as the server and the remaining nodes as workers. The steps for starting and stopping the grid appliance service are as outlined below:

1. Stop the grid_appliance service in the grid-appliance

   /etc/init.d/

   grid_appliance.sh stop exit

2. Download the GroupVPN floppy to your local system from the grid-appliance website. Transfer it to the Grid Appliance workspace using scp or sftp.

? scp - i userkey.private floopy.img (server)

root@public.ip.address:/opt/grid_appliance/etc/

scp - i userkey.private floopy.img (worker)

root@public.ip.address:/opt/grid_appliance/etc/

1. SSH back into grid appliance and start the grid appliance service

   ssh -i userkey.private root@public.ip.address

   /etc/init.d/grid_appliance.sh start

IV. Setup Twister Environment¶

1. Edit $TWISTER_HOME/bin/twister.properties and set the correct paths to the following:

nodes_file = /opt/Twister/bin/nodes

app_dir = /opt/Twister/apps

data_dir = /opt/Twister/data

pubsub_broker = Naradabrokering

= (to the IP address on the tapipop interface of the machine you designated as the server) | 3. Edit $TWISTER_HOME/bin/nodes and add your IP addresses on the tapipop interface of the machines you designated as workers.

V. Twister-Kmeans¶

Open two terminals - One for starting the broker and the second for starting Twister.

For steps 2 - 4, execute the following commands on the second terminal.

$ cd /opt/Naradabrokering/bin/
$ chmod 755 startbr.sh
$ ./startbr.sh

$ cd /opt/Twister/bin
$ chmod 755 start\_twister.sh
$ ./start\_twister.sh

$ cd /opt/Twister/samples/kmeans
$ ant
$ cd ../../lib
$ mv Twister-Kmeans-0.9.jar ../apps/

$ cd /opt/Twister/bin
$ ./twister.sh mkdir kmeans

$ cd /opt/Twister/samples/kmeans/bin/
$./gen\_data.sh init\_clusters.txt 2 3 kmeans km\_data 3 30000

Execute Twister-Kmeans application¶

$ ./run_kmeans.sh init_clusters.txt 3 p.pf

The output is as follows:

A video detailing the above steps can be shown here password: tutorial