Table of Contents
- Introduction
- Following commands will be added to the hmc for "hscroot" id
- xCAT command
- The steps to setup the hmc for a cluster
{{:Design Warning}}
Mini-design of sol/bmc setup for hmc [TOC]
Introduction
The remote console to the hmc is important for a cluster with large number of hmcs. Since hmc is working on a restrict linux, some commands and functions which are necessary for the remote console are not available for the general user id "hscroot". If xCAT would like to make sol/bmc setup work for "hscroot" user, some new hmc commands are needed to setup the sol and bmc in "hscroot" id. hmc people is working on two commands to turn on/off sol and setup the bmc, xCAT can use these commands to implement the remote console for hmc.
Following commands will be added to the hmc for "hscroot" id
Setup the sol
chhmc --sol -s {enable | disable}
enable - will add the configuration
disable - will remove the configuration
Following things will be done when enable the sol:
- Redirect the remote console to the com1; do the related configuration in the BIOS. (in the development phase)
- Add a line in the /etc/inittab and /boot/grub/menu.lst to open the tty when booting the hmc.
- Setup the bmc. (in the development phase)
- Possibly to make ipmitool available on hmc?
Setup the bmc
Following functions will be supported for the bmc setup on hmc:
-
Setup the network information (IP/Netmask/Gateway) for the bmc.
chhmc -c imm -s modify -a <imm_ipaddr> -nm <imm_netmask_ipaddr>
-
Setup the user/password for the bmc.
chhmc -c imm -s modify -u <imm_login_id> -p <imm_passwd>
-
Configure the interface mod of IMM. The value can be one of 'Dedicated' or 'Shared'.
chhmc -c imm -s modify -i <if_mode>
xCAT command
xCAT has the command rspconfig to handle the configuration for the service processor of a node. For the sol and bmc setup of the hmc, the rspconfig command is a good place to implement them.
Turn on/off the sol
rspconfig <noderange> solcfg={enable|disable}
The hmc command 'chhmc' will be called directly (ssh) to handle the on/off operations.
Setup the network for the bmc
rspconfig <noderange> network={[ip],[netmask] | *}
The hmc will have a command to handle this. If specifying the argument 'network=*', the ip/netmask/gateway information will be gotten from xCAT DB.
Setup the user/password for the bmc
rspconfig <noderange> bmc_userpwd={newuser,newpasswd}
The hmc will have a command to handle this. The old user/passwd will be gotten from xCAT DB. After the successfully setup, the new user:passwd should be written into xCAT DB.
Configure the interface mode for the bmc
rspconfig <noderange> bmc_ifmode={Dedicated|Shared}
In Dedicated mode, the IMM is using the IMM-eth to communicate (Out-of-Band); In Shared mode, the IMM will using the eth0 of hmc host to communicate (In-Band).
The steps to setup the hmc for a cluster
Hardware setup
Both of the hmc and bmc should be connected to the service network, so that xCAT can communicate with them for management. A hmc has three ethernet interfaces: one for IMM management (it can be named IMM-eth0); two for the hmc host (they can named hmc-eth0, hmc-eth1). The IMM suppots In-Band and Out-of-Band for communication.
In-Band: Using the hmc-eth0 for communication. It is set by Shared mode.
Out-Band: Using the IMM-eth0 for communiction. It is set by Dedicated mode.
For the redundancy support, there are two service networks for failover. The hmc-eth0 should be connected to the Primary network; the hmc-eth1 of hmc host and IMM-eth0 should be connected to the Secondary network.
- When the cluster is working in Primary network, the IMM interface should be set to 'Shared' mode. In this case, both hmc and bmc are using the hmc-eth0 for communication.
- When the cluster is working in Secondary network, the IMM interface should be set to 'Dedicated' mode. In this case, IMM is using the IMM-eth0 for communicatation but the hmc is using the hmc-eth1 for communication.
Define the hmc object
There are two possible methods to defined the hmc in a cluster, we still need to investigate that whether they are workable.
Method 1 1. Install the hmc hardware during the setup of a cluster.
2. Manually collect the mac addresses of all hmcs. Assign hostname, 'OS level IP' and 'BMC level IP' to all hmcs. Add the hostname and 'OS level IP' mapping of hmcs in the /etc/hosts file.
3. Define all the hmcs into the xCAT DB. The hmc objects should include following attributes:
Object name: hmc1
bmc=<bmc_ip>
bmcpassword=<bmc_passwd>
bmcusername=<bmc_user>
mac=xx:xx:xx:xx:xx:xx
cons=ipmi
groups=hmc,all
mgt=ipmi
serialflow=hard
serialport=0
serialspeed=19200
4. Run 'makedhcp -a' to add the IP-MAC mapping in the dhcpd lease file.
5. Manually boot up the hmcs. The hmcs will get network configuration which defined in step2 from dhcp server.
The method 2 1. Assign a IP range in the xCAT dhcp server for the hmc in a cluster. 2. Power on the hmc to make each of them get a dynamic IP. 3. run the lsslp to get the information of each hmc. 4. Admin needs to map them to the physical hmc and define a xCAT object base on this information.
Configure the bmc for SOL support
1. Setup the network for bmc:
rspconfig hmc network=*
2. Change the user/password for bmc: (Optinal)
rspconfig hmc bmc_userpwd=user,passwd
3. Enable the sol for hmc:
rspconfig hmc solcfg=enable
News
- Apr 22, 2016: xCAT 2.11.1 released.
- Mar 11, 2016: xCAT 2.9.3 (AIX only) released.
- Dec 11, 2015: xCAT 2.11 released.
- Nov 11, 2015: xCAT 2.9.2 (AIX only) released.
- Jul 30, 2015: xCAT 2.10 released.
- Jul 30, 2015: xCAT migrates from sourceforge to github
- Jun 26, 2015: xCAT 2.7.9 released.
- Mar 20, 2015: xCAT 2.9.1 released.
- Dec 12, 2014: xCAT 2.9 released.
- Sep 5, 2014: xCAT 2.8.5 released.
- May 23, 2014: xCAT 2.8.4 released.
- Jan 24, 2014: xCAT 2.7.8 released.
- Nov 15, 2013: xCAT 2.8.3 released.
- Jun 26, 2013: xCAT 2.8.2 released.
- May 17, 2013: xCAT 2.7.7 released.
- May 10, 2013: xCAT 2.8.1 released.
- Feb 28, 2013: xCAT 2.8 released.
- Nov 30, 2012: xCAT 2.7.6 released.
- Oct 29, 2012: xCAT 2.7.5 released.
- Aug 27, 2012: xCAT 2.7.4 released.
- Jun 22, 2012: xCAT 2.7.3 released.
- May 25, 2012: xCAT 2.7.2 released.
- Apr 20, 2012: xCAT 2.7.1 released.
- Mar 19, 2012: xCAT 2.7 released.
- Mar 15, 2012: xCAT 2.6.11 released.
- Jan 23, 2012: xCAT 2.6.10 released.
- Nov 15, 2011: xCAT 2.6.9 released.
- Sep 30, 2011: xCAT 2.6.8 released.
- Aug 26, 2011: xCAT 2.6.6 released.
- May 20, 2011: xCAT 2.6 released.
- Feb 14, 2011: Watson plays on Jeopardy and is managed by xCAT!
- xCAT Release Notes Summary
- xCAT OS And Hw Support Matrix
- xCAT Test Environment Summary
History
- Oct 22, 2010: xCAT 2.5 released.
- Apr 30, 2010: xCAT 2.4 is released.
- Oct 31, 2009: xCAT 2.3 released.
xCAT's 10 year anniversary! - Apr 16, 2009: xCAT 2.2 released.
- Oct 31, 2008: xCAT 2.1 released.
- Sep 12, 2008: Support for xCAT 2
can now be purchased! - June 9, 2008: xCAT breaths life into
(at the time) the fastest
supercomputer on the planet - May 30, 2008: xCAT 2.0 for Linux
officially released! - Oct 31, 2007: IBM open sources
xCAT 2.0 to allow collaboration
among all of the xCAT users. - Oct 31, 1999: xCAT 1.0 is born!
xCAT started out as a project in
IBM developed by Egan Ford. It
was quickly adopted by customers
and IBM manufacturing sites to
rapidly deploy clusters.