Package starcluster :: Package plugins :: Module hadoop :: Class Hadoop
[hide private]
[frames] | no frames]

Class Hadoop

source code


Configures Hadoop using Cloudera packages on StarCluster

Instance Methods [hide private]
 
__init__(self, hadoop_tmpdir='/mnt/hadoop')
x.__init__(...) initializes x; see x.__class__.__doc__ for signature
source code
 
_get_java_home(self, node) source code
 
_get_alternatives_cmd(self, node) source code
 
_setup_hadoop_user(self, node, user) source code
 
_install_empty_conf(self, node) source code
 
_configure_env(self, node) source code
 
_configure_mapreduce_site(self, node, cfg) source code
 
_configure_core(self, node, cfg) source code
 
_configure_hdfs_site(self, node, cfg) source code
 
_configure_masters(self, node, master) source code
 
_configure_slaves(self, node, node_aliases) source code
 
_setup_hdfs(self, node, user) source code
 
_setup_dumbo(self, node) source code
 
_configure_hadoop(self, master, nodes, user) source code
 
_setup_hadoop_dir(self, node, path, user, group, permission='775') source code
 
_start_datanode(self, node) source code
 
_start_tasktracker(self, node) source code
 
_start_hadoop(self, master, nodes) source code
 
_open_ports(self, master) source code
 
run(self, nodes, master, user, user_shell, volumes)
Run this plugin's setup routines
source code

Inherited from clustersetup.ClusterSetup: on_add_node, on_remove_node, on_restart, on_shutdown

Inherited from object: __delattr__, __format__, __getattribute__, __hash__, __new__, __reduce__, __reduce_ex__, __repr__, __setattr__, __sizeof__, __str__, __subclasshook__

Properties [hide private]
  pool

Inherited from object: __class__

Method Details [hide private]

__init__(self, hadoop_tmpdir='/mnt/hadoop')
(Constructor)

source code 

x.__init__(...) initializes x; see x.__class__.__doc__ for signature

Overrides: object.__init__
(inherited documentation)

run(self, nodes, master, user, user_shell, volumes)

source code 

Run this plugin's setup routines

This method gets executed after the default cluster setup routines have been performed

Overrides: clustersetup.ClusterSetup.run
(inherited documentation)

Property Details [hide private]

pool

Get Method:
unreachable.pool(self)