mirror of
https://github.com/xcat2/xcat-core.git
synced 2025-08-26 13:10:35 +00:00
modify depending on comments
This commit is contained in:
@@ -1,7 +1,7 @@
|
||||
IB Driver Preparation and Installation
|
||||
======================================
|
||||
|
||||
XCAT provides one sample postscript to help you install the **Mellanox OpenFabrics Enterprise Distribution** (OFED) Infiniband Driver. This shell script is ``/opt/xcat/share/xcat/ib/scripts/Mellanox/mlnxofed_ib_install``. You can use this script directly or just refer to it then change it to satisfy your own environment. From xCAT2.11, XCAT offers a new version of mlnxofed_ib_install(i.e. mlnxofed_ib_install.v2). From the perspective of function, the v2 is forward compatible with v1. But the v2 has different usage interface from v1. it becomes more flexible. we still ship v1 with XCAT **but stop support it from xCAT2.11**. We recommend to use mlnxofed_ib_install.v2.
|
||||
xCAT provides sample postscripts to help you install the Mellanox OpenFabrics Enterprise Distribution (OFED) Infiniband Driver. These scripts are located in ``opt/xcat/share/xcat/ib/scripts/Mellanox/``. You can use these scripts directly or change them to satisfy your own environment. **xCAT 2.11 drops support of mlnxofed_ib_install and recommends using version 2 of the script: mlnxofed_ib_install.v2**.
|
||||
|
||||
.. toctree::
|
||||
:maxdepth: 2
|
||||
|
@@ -36,7 +36,7 @@ Note: the above 0002:01:00.0 device location was used as an example only. it is
|
||||
Mellanox Switch Firmware Upgrade
|
||||
--------------------------------
|
||||
|
||||
This section provides manual procedure to help update the firmware for Mellanox Infiniband (IB) Switches. You can down load IB switch firmware like IB6131 (image-PPC_M460EX-SX_3.2.xxx.img) from the Mellanox website `http://www.mellanox.com/page/firmware_table_IBM <http://www.mellanox.com/page/firmware_table_IBM>`_ and place into your XCAT Management Node or server that can communicate to Flex IB6131 switch module. There are two ways to update the MLNX-OS switch package. This process works regardless if updating an internal PureFlex chassis Infiniband switch (IB6131 or for an external Mellanox switch.
|
||||
This section provides manual procedure to help update the firmware for Mellanox Infiniband (IB) Switches. You can down load IB switch firmware like IB6131 (image-PPC_M460EX-SX_3.2.xxx.img) from the Mellanox website `http://www.mellanox.com/page/firmware_table_IBM <http://www.mellanox.com/page/firmware_table_IBM>`_ and place into your xCAT Management Node or server that can communicate to Flex IB6131 switch module. There are two ways to update the MLNX-OS switch package. This process works regardless if updating an internal PureFlex chassis Infiniband switch (IB6131 or for an external Mellanox switch.
|
||||
|
||||
Update via Browser
|
||||
^^^^^^^^^^^^^^^^^^
|
||||
|
@@ -1,6 +1,8 @@
|
||||
Infiniband (Mellanox)
|
||||
=====================
|
||||
|
||||
xCAT offers a certain degree support for Mellanox infiniband product, it help you to configurate Mellanox infiniband products easily.
|
||||
|
||||
.. toctree::
|
||||
:maxdepth: 2
|
||||
|
||||
|
@@ -0,0 +1,28 @@
|
||||
Configuration for Diskful Installation
|
||||
======================================
|
||||
|
||||
1. Set script ``mlnxofed_ib_install`` as postbootscript ::
|
||||
|
||||
chdef <node> -p postbootscripts=mlnxofed_ib_install
|
||||
|
||||
2. Specify dependence package **[required for RHEL and SLES]**
|
||||
|
||||
a) Copy the pkglist to the custom directory ::
|
||||
|
||||
cp /opt/xcat/share/xcat/install/<ostype>/compute.<osver>.<arch>.pkglist \
|
||||
/install/custom/install/<ostype>/compute.<osver>.<arch>.pkglist
|
||||
|
||||
b) Edit your /install/custom/install/<ostype>/compute.<osver>.<arch>.pkglist and add one line::
|
||||
|
||||
#INCLUDE:/opt/xcat/share/xcat/ib/netboot/<ostype>/ib.<osver>.<arch>.pkglist#
|
||||
|
||||
c) Make the related osimage use the customized pkglist ::
|
||||
|
||||
chdef -t osimage -o <osver>-<arch>-install-compute \
|
||||
pkglist=/install/custom/install/<ostype>/compute.<osver>.<arch>.pkglist
|
||||
|
||||
3. Install node ::
|
||||
|
||||
nodeset <node> osimage=<osver>-<arch>-install-compute
|
||||
rsetboot <node> net
|
||||
rpower <node> reset
|
@@ -0,0 +1,52 @@
|
||||
Configuration for Diskless Installation
|
||||
=======================================
|
||||
|
||||
1. Specify dependence package **[required for RHEL and SLES]**
|
||||
|
||||
a) Copy the pkglist to the custom directory ::
|
||||
|
||||
cp /opt/xcat/share/xcat/netboot/<ostype>/compute.<osver>.<arch>.pkglist \
|
||||
/install/custom/netboot/<ostype>/compute.<osver>.<arch>.pkglist
|
||||
|
||||
b) Edit your ``/install/custom/netboot/<ostype>/<profile>.pkglist`` and add one line ``#INCLUDE:/opt/xcat/share/xcat/ib/netboot/<ostype>/ib.<osver>.<arch>.pkglist#``
|
||||
|
||||
2. Prepare postinstall scripts
|
||||
|
||||
a) Specify postinstall scripts::
|
||||
|
||||
mkdir -p /install/custom/netboot/<ostype>/
|
||||
|
||||
cp /opt/xcat/share/xcat/netboot/<ostype>/<profile>.postinstall \
|
||||
/install/custom/netboot/<ostype>/
|
||||
|
||||
chmod +x /install/custom/netboot/<ostype>/<profile>.postinstall
|
||||
|
||||
b) Edit ``/install/custom/netboot/<ostype>/<profile>.postinstall`` and add below line in the end: ::
|
||||
|
||||
installroot=$1 ofeddir=/install/post/otherpkgs/<osver>/<arch>/ofed/ \
|
||||
NODESETSTATE=genimage mlnxofed_options=--force /install/postscripts/mlnxofed_ib_install
|
||||
|
||||
|
||||
3. Set the related osimage use the customized pkglist and customized compute.postinsall
|
||||
|
||||
* [RHEL/SLES] ::
|
||||
|
||||
chdef -t osimage -o <osver>-<arch>-netboot-compute \
|
||||
pkglist=/install/custom/netboot/<ostype>/compute.<osver>.<arch>.pkglist \
|
||||
postinstall=/install/custom/netboot/<ostype>/<profile>.postinstall
|
||||
|
||||
* [Ubuntu] ::
|
||||
|
||||
chdef -t osimage -o <osver>-<arch>-netboot-compute \
|
||||
postinstall=/install/custom/netboot/<ostype>/<profile>.postinstall
|
||||
|
||||
4. Generate and package image for diskless installation ::
|
||||
|
||||
genimage <osver>-<arch>-netboot-compute
|
||||
packimage <osver>-<arch>-netboot-compute
|
||||
|
||||
5. Install node ::
|
||||
|
||||
nodeset <nodename> osimage=<osver>-<arch>-netboot-compute
|
||||
rsetboot <nodename> net
|
||||
rpower <nodename> reset
|
@@ -0,0 +1,42 @@
|
||||
Preparation
|
||||
===========
|
||||
|
||||
Obtain the Mellanox OFED ISO file from `Mellanox official site <http://www.mellanox.com/page/products_dyn?product_family=26&mtag=linux_sw_drivers>`_ and mount it onto suggested target location on the xCAT MN according your OS and ARCH: ::
|
||||
|
||||
mkdir -p /install/post/otherpkgs/<osver>/<arch>/ofed
|
||||
|
||||
mount -o loop MLNX_OFED_LINUX-<packver1>-<packver2>-<osver>-<arch>.iso \
|
||||
/install/post/otherpkgs/<osver>/<arch>/ofed
|
||||
|
||||
Take sles11 sp1 for x86_64 as an example ::
|
||||
|
||||
mkdir -p /install/post/otherpkgs/sles11.1/x86_64/ofed/
|
||||
|
||||
mount -o loop MLNX_OFED_LINUX-1.5.3-3.0.0-sles11sp1-x86_64.iso \
|
||||
/install/post/otherpkgs/sles11.1/x86_64/ofed/
|
||||
|
||||
|
||||
Take Ubuntu14.4.1 for Power8 LE as an example ::
|
||||
|
||||
mkdir -p /install/post/otherpkgs/ubuntu14.04.1/ppc64el/ofed
|
||||
|
||||
mount -o loop MLNX_OFED_LINUX-2.3-1.0.1-ubuntu14.04-ppc64le.iso \
|
||||
/install/post/otherpkgs/ubuntu14.04.1/ppc64el/ofed
|
||||
|
||||
|
||||
**[NOTE]**
|
||||
|
||||
* Mellanox provides OFED files with **tarball** and **ISO** two format, but for xCAT, we just support **ISO** format right now.
|
||||
|
||||
Copy Sample script **mlnxofed_ib_install** shipped by xCAT into ``/install/postscripts`` before using, such as ::
|
||||
|
||||
cp /opt/xcat/share/xcat/ib/scripts/Mellanox/mlnxofed_ib_install \
|
||||
/install/postscripts/mlnxofed_ib_install
|
||||
|
||||
The **mlnxofed_ib_install** invokes a script ``mlnxofedinstall`` shipped by Mellanox OFED ISO. If you want to pass the argument to ``mlnxofedinstall``, you set the argument to the environment variable ``mlnxofed_options`` which could be read by **mlnxofed_ib_install**. For example: PPE requires the 32-bit version of libibverbs, but the default **mlnxofed_ib_install** will remove all the old ib related packages at first including the 32-bit version of libibverbs. In this case, you can set the environment variable ``mlnxofed_options=--force`` when running the **mlnxofed_ib_install**. For diskful, you should put the environment variable ``mlnxofed_options=--force`` in mypostscript.tmpl. myposcript.tmpl is in ``/opt/xcat/share/xcat/templates/mypostscript/`` by default. When customize it, you should copy it into ``/install/postscripts/myposcript.tmpl`` ::
|
||||
|
||||
mlnxofed_options='--force'
|
||||
export mlnxofed_options
|
||||
|
||||
|
||||
|
@@ -1,22 +1,9 @@
|
||||
The Usage of mlnxofed_ib_install
|
||||
================================
|
||||
Using mlnxofed_ib_install (drops support)
|
||||
=========================================
|
||||
|
||||
Configuration for Diskfull Installation
|
||||
---------------------------------------
|
||||
.. include:: ./mlnxofed_ib_install_common_usage.rst
|
||||
:start-after: BEGIN_Preparation_For_V1
|
||||
:end-before: END_Preparation_For_V1
|
||||
.. toctree::
|
||||
:maxdepth: 1
|
||||
|
||||
.. include:: ./mlnxofed_ib_install_common_usage.rst
|
||||
:start-after: BEGIN_Diskfull_step_For_V1
|
||||
:end-before: END_Diskfull_step_For_V1
|
||||
|
||||
Configuration for Diskless Installation
|
||||
---------------------------------------
|
||||
.. include:: ./mlnxofed_ib_install_common_usage.rst
|
||||
:start-after: BEGIN_Preparation_For_V1
|
||||
:end-before: END_Preparation_For_V1
|
||||
|
||||
.. include:: ./mlnxofed_ib_install_common_usage.rst
|
||||
:start-after: BEGIN_Diskless_step_For_V1
|
||||
:end-before: END_Diskless_step_For_V1
|
||||
mlnxofed_ib_install_v1_preparation.rst
|
||||
mlnxofed_ib_install_v1_diskful.rst
|
||||
mlnxofed_ib_install_v1_diskless.rst
|
@@ -0,0 +1,28 @@
|
||||
Configuration for Diskful Installation
|
||||
=======================================
|
||||
|
||||
1. Set script ``mlnxofed_ib_install`` as postbootscript ::
|
||||
|
||||
chdef <node> -p postbootscripts="mlnxofed_ib_install -p /install/<path>/<MLNX_OFED_LINUX.iso>"
|
||||
|
||||
2. Specify dependence package **[required for RHEL and SLES]**
|
||||
|
||||
a) Copy a correct pkglist file shipped by xCAT according your environment to the ``/install/custom/install/<ostype>/`` directory ::
|
||||
|
||||
cp /opt/xcat/share/xcat/install/<ostype>/compute.<osver>.<arch>.pkglist \
|
||||
/install/custom/install/<ostype>/compute.<osver>.<arch>.pkglist
|
||||
|
||||
b) Edit your ``/install/custom/install/<ostype>/compute.<osver>.<arch>.pkglist`` and add below line::
|
||||
|
||||
#INCLUDE:/opt/xcat/share/xcat/ib/netboot/<ostype>/ib.<osver>.<arch>.pkglist#
|
||||
|
||||
c) Make the related osimage use the customized pkglist ::
|
||||
|
||||
chdef -t osimage -o <osver>-<arch>-install-compute \
|
||||
pkglist=/install/custom/install/<ostype>/compute.<osver>.<arch>.pkglist
|
||||
|
||||
3. Install node ::
|
||||
|
||||
nodeset <node> osimage=<osver>-<arch>-install-compute
|
||||
rsetboot <node> net
|
||||
rpower <node> reset
|
@@ -0,0 +1,54 @@
|
||||
Configuration for Diskless Installation
|
||||
=======================================
|
||||
|
||||
1. Specify dependence package **[required for RHEL and SLES]**
|
||||
|
||||
a) Copy a correct pkglist file shipped by xCAT according your environment to the ``/install/custom/netboot/<ostype>/`` directory ::
|
||||
|
||||
cp /opt/xcat/share/xcat/netboot/<ostype>/compute.<osver>.<arch>.pkglist \
|
||||
/install/custom/netboot/<ostype>/compute.<osver>.<arch>.pkglist
|
||||
|
||||
b) Edit your ``/install/custom/netboot/<ostype>/<profile>.pkglist`` and add below line ::
|
||||
|
||||
#INCLUDE:/opt/xcat/share/xcat/ib/netboot/<ostype>/ib.<osver>.<arch>.pkglist#
|
||||
|
||||
2. Prepare postinstall scripts
|
||||
|
||||
a) Specify postinstall scripts ::
|
||||
|
||||
mkdir -p /install/custom/netboot/<ostype>/
|
||||
|
||||
cp /opt/xcat/share/xcat/netboot/<ostype>/<profile>.postinstall \
|
||||
/install/custom/netboot/<ostype>/
|
||||
|
||||
chmod +x /install/custom/netboot/<ostype>/<profile>.postinstall
|
||||
|
||||
b) Edit ``/install/custom/netboot/<ostype>/<profile>.postinstall`` and add below line in the end ::
|
||||
|
||||
/install/postscripts/mlnxofed_ib_install \
|
||||
-p /install/<path>/<MLNX_OFED_LINUX.iso> -i $1 -n genimage
|
||||
|
||||
|
||||
3. Set the related osimage using the customized pkglist and compute.postinsall
|
||||
|
||||
* [RHEL/SLES] ::
|
||||
|
||||
chdef -t osimage -o <osver>-<arch>-netboot-compute \
|
||||
pkglist=/install/custom/netboot/<ostype>/compute.<osver>.<arch>.pkglist \
|
||||
postinstall=/install/custom/netboot/<ostype>/<profile>.postinstall
|
||||
|
||||
* [Ubuntu] ::
|
||||
|
||||
chdef -t osimage -o <osver>-<arch>-netboot-compute \
|
||||
postinstall=/install/custom/netboot/<ostype>/<profile>.postinstall
|
||||
|
||||
4. Generate and package image for diskless installation ::
|
||||
|
||||
genimage <osver>-<arch>-netboot-compute
|
||||
packimage <osver>-<arch>-netboot-compute
|
||||
|
||||
5. Install node ::
|
||||
|
||||
nodeset <nodename> osimage=<osver>-<arch>-netboot-compute
|
||||
rsetboot <nodename> net
|
||||
rpower <nodename> reset
|
@@ -0,0 +1,34 @@
|
||||
Preparation
|
||||
===========
|
||||
|
||||
Obtain the Mellanox OFED ISO file from `Mellanox official site <http://www.mellanox.com/page/products_dyn?product_family=26&mtag=linux_sw_drivers>`_ and put it into one place under ``/install`` directory depending on your need.
|
||||
|
||||
**[NOTE]**
|
||||
|
||||
* Mellanox provides OFED drivers in **tarball** and **iso** formats. xCAT only supports the **iso** format at this time.
|
||||
* Mellanox provides different OFED ISOs depending on operating system and machine architecture, named like MLNX_OFED_LINUX-<packver1>-<packver2>-<osver>-<arch>.iso, you should download correct one according your environment.
|
||||
|
||||
Copy **mlnxofed_ib_install.v2** into ``/install/postscripts`` and change name to **mlnxofed_ib_install** ::
|
||||
|
||||
cp /opt/xcat/share/xcat/ib/scripts/Mellanox/mlnxofed_ib_install.v2 \
|
||||
/install/postscripts/mlnxofed_ib_install
|
||||
|
||||
chmod +x /install/postscripts/mlnxofed_ib_install
|
||||
|
||||
Some options of mlnxofed_ib_install should be assigned values when it's used.
|
||||
These options are:
|
||||
|
||||
* **-p**: [required]--the directory where the OFED iso file is located
|
||||
* **-m**: [optional]--the mlnxofed_ib_install invokes a script ``mlnxofedinstall`` shipped by Mellanox OFED iso. Use this option to pass arguments to the ``mlnxofedinstall``. You must include ``-end-`` at the completion of the options to distinguish the option list. if you don't pass any argument to ``mlnxofedinstall``, defualt value ``--without-32bit --without-fw-update --force`` will be passed to ``mlnxofedinstall`` by xCAT.
|
||||
* **-i**: [required for diskless]--the image root path
|
||||
* **-n**: [required for diskless]--nodeset status, the value is 'genimage'.
|
||||
|
||||
In general you can use ``mlnxofed_ib_install`` like below ::
|
||||
|
||||
mlnxofed_ib_install -p /install/<path>/<MLNX_OFED_LINUX.iso>
|
||||
|
||||
If need to pass ``--without-32bit --without-fw-update --add-kernel-support --force`` to ``mlnxofedinstall`` in diskless scenario, refer to below command ::
|
||||
|
||||
mlnxofed_ib_install -p /install/<path>/<MLNX_OFED_LINUX.iso> \
|
||||
-m --without-32bit --without-fw-update --add-kernel-support --force -end- \
|
||||
-i /<imagepath> -n genimage
|
@@ -1,22 +1,10 @@
|
||||
The Usage of mlnxofed_ib_install.v2 (Recommend)
|
||||
===============================================
|
||||
Using mlnxofed_ib_install.v2 (Recommend)
|
||||
=========================================
|
||||
|
||||
Configuration for Diskfull Installation
|
||||
---------------------------------------
|
||||
.. include:: ./mlnxofed_ib_install_common_usage.rst
|
||||
:start-after: BEGIN_Preparation_For_V2
|
||||
:end-before: END_Preparation_For_V2
|
||||
.. toctree::
|
||||
:maxdepth: 1
|
||||
|
||||
.. include:: ./mlnxofed_ib_install_common_usage.rst
|
||||
:start-after: BEGIN_Diskfull_step_For_V2
|
||||
:end-before: END_Diskfull_step_For_V2
|
||||
|
||||
Configuration for Diskless Installation
|
||||
---------------------------------------
|
||||
.. include:: ./mlnxofed_ib_install_common_usage.rst
|
||||
:start-after: BEGIN_Preparation_For_V2
|
||||
:end-before: END_Preparation_For_V2
|
||||
|
||||
.. include:: ./mlnxofed_ib_install_common_usage.rst
|
||||
:start-after: BEGIN_Diskless_step_For_V2
|
||||
:end-before: END_Diskless_step_For_V2
|
||||
mlnxofed_ib_install_v2_preparation.rst
|
||||
mlnxofed_ib_install_v2_diskful.rst
|
||||
mlnxofed_ib_install_v2_diskless.rst
|
||||
|
||||
|
@@ -1,13 +1,11 @@
|
||||
IB Network Configuration
|
||||
========================
|
||||
|
||||
XCAT provided two sample postscripts - configiba.1port and configiba.2ports to configure the IB adapter before XCAT 2.8, these tow scripts still work **but will be in maintenance mode**.
|
||||
xCAT provides a script ``configib`` to help configure the Infiniband adapters on the compute nodes.
|
||||
|
||||
A new postscript ``/install/postscripts/configib`` is shipped with XCAT 2.8, the ``configib`` postscript works with the new "nics" table and ``confignic`` postscript which is introduced in XCAT 2.8 also. XCAT recommends you to use new ``configib`` script from now on.
|
||||
The Infiniband adapter is considered an additional interface for xCAT. The process for configuring Infiniband adapters complies with the process of :doc:`Configure Additional Network Interfaces <../../../../guides/admin-guides/manage_clusters/ppc64le/diskful/customize_image/cfg_second_adapter>`.
|
||||
|
||||
IB Interface is a kind of additional adapters for XCAT, so the process of configuring Mellanox IB interface complies with the process of :doc:`Configure Additional Network Interfaces <../../../../guides/admin-guides/manage_clusters/ppc64le/diskful/customize_image/cfg_second_adapter>`.
|
||||
|
||||
Below are an simple example to configure Mellanox IB in ubuntu14.4.1 on p8le
|
||||
Below are an simple example to configure Mellanox IB in Ubuntu 14.04.1 on Power8 LE
|
||||
|
||||
If your target Mellanox IB adapter has 2 ports, and you plan to give port ib0 4 different IPs, 2 are IPV4 (20.0.0.3 and 30.0.0.3) and another 2 are IPV6 (1:2::3 and 2:2::3).
|
||||
|
||||
@@ -20,18 +18,19 @@ If your target Mellanox IB adapter has 2 ports, and you plan to give port ib0 4
|
||||
|
||||
2. Define IPs for ib0 ::
|
||||
|
||||
chdef <node> nicips.ib0="20.0.0.3|30.0.0.3|1:2::3|2:2::3" nicnetworks.ib0="ib0ipv41|ib0ipv42|ib0ipv61|ib0ipv62" nictypes.ib0="Infiniband"
|
||||
chdef <node> nicips.ib0="20.0.0.3|30.0.0.3|1:2::3|2:2::3" \
|
||||
nicnetworks.ib0="ib0ipv41|ib0ipv42|ib0ipv61|ib0ipv62" nictypes.ib0="Infiniband"
|
||||
|
||||
3. Configure ib0
|
||||
|
||||
Configure during node installation ::
|
||||
* To configure during node installation ::
|
||||
|
||||
chdef <node> -p postscripts="confignics --ibaports=2"
|
||||
nodeset <node> osimage=<osimagename>
|
||||
rsetboot <node> net
|
||||
rpower <node> reset
|
||||
|
||||
Configure on a node which has have operating system ::
|
||||
* To configure on a node which has had operating system ::
|
||||
|
||||
updatenode <node> -P "confignics --ibaports=2"
|
||||
|
||||
|
@@ -1,10 +1,10 @@
|
||||
IB Switch Configuration
|
||||
=======================
|
||||
|
||||
Setup the XCAT Database
|
||||
Setup the xCAT Database
|
||||
-----------------------
|
||||
|
||||
The Mellanox Switch is only supported in XCAT Release 2.7 or later.
|
||||
The Mellanox Switch is only supported in xCAT Release 2.7 or later.
|
||||
|
||||
Add the switch ip address in the ``/etc/hosts`` file
|
||||
|
||||
@@ -21,7 +21,7 @@ The switches table will look like this: ::
|
||||
#switch,...,sshusername,sshpassword,switchtype,....
|
||||
"mswitch",,,,,,,"admin","admin","MellanoxIB",,
|
||||
|
||||
If there is only one admin and one password for all the switches then put the entry in the XCAT passwd table for the admin id and password to use to login. ::
|
||||
If there is only one admin and one password for all the switches then put the entry in the xCAT passwd table for the admin id and password to use to login. ::
|
||||
|
||||
tabch key=mswitch passwd.username=admin passwd.password=admin
|
||||
|
||||
@@ -33,7 +33,7 @@ The passwd table will look like this: ::
|
||||
Setup ssh connection to the Mellanox Switch
|
||||
-------------------------------------------
|
||||
|
||||
To run commands like xdsh and script to the Mellanox Switch, we need to setup ssh to run without prompting for a password to the Mellanox Switch. To do this, first you must add a configuration file. This configuration file is NOT needed for XCAT 2.8 and later. ::
|
||||
To run commands like xdsh and script to the Mellanox Switch, we need to setup ssh to run without prompting for a password to the Mellanox Switch. To do this, first you must add a configuration file. This configuration file is NOT needed for xCAT 2.8 and later. ::
|
||||
|
||||
mkdir -p /var/opt/xcat/IBSwitch/Mellanox
|
||||
cd /var/opt/xcat/IBSwitch/Mellanox
|
||||
@@ -72,13 +72,14 @@ Use the following command to consolidate the syslog to the Management Node or Se
|
||||
|
||||
Configure xdsh for Mellanox Switch
|
||||
----------------------------------
|
||||
To run xdsh commands to the Mellanox Switch, you must use the --devicetype input flag to xdsh. In addition, for XCAT versions less than 2.8, you must add a configuration file, please see **"Setup ssh connection to the Mellanox Switch"** section.
|
||||
To run xdsh commands to the Mellanox Switch, you must use the --devicetype input flag to xdsh. In addition, for xCAT versions less than 2.8, you must add a configuration file, please see `Setup ssh connection to the Mellanox Switch`_ section.
|
||||
|
||||
For the Mellanox Switch the --devicetype is "IBSwitch::Mellanox". See xdsh man page: TODO `http://xcat.sourceforge.net/man1/xdsh.1.html <http://xcat.sourceforge.net/man1/xdsh.1.html>`_ for details.
|
||||
For the Mellanox Switch the ``--devicetype`` is ``IBSwitch::Mellanox``. See :doc:`xdsh man page <../../../guides/admin-guides/references/man/xdsh.1.html>` for details.
|
||||
|
||||
Now you can run the switch commands from the mn using xdsh. For example: ::
|
||||
|
||||
xdsh mswitch -l admin --devicetype IBSwitch::Mellanox 'enable;configure terminal;show ssh server host-keys'
|
||||
xdsh mswitch -l admin --devicetype IBSwitch::Mellanox \
|
||||
'enable;configure terminal;show ssh server host-keys'
|
||||
|
||||
Commands Supported for the Mellanox Switch
|
||||
------------------------------------------
|
||||
@@ -115,7 +116,7 @@ For doing other tasks on the switch, use xdsh. For example: ::
|
||||
|
||||
Interactive commands are not supported by xdsh. For interactive commands, use ssh.
|
||||
|
||||
Send SNMP traps to XCAT Management Node
|
||||
Send SNMP traps to xCAT Management Node
|
||||
---------------------------------------
|
||||
|
||||
First, get `http://www.mellanox.com/related-docs/prod_ib_switch_systems/MELLANOX-MIB.zip <http://www.mellanox.com/related-docs/prod_ib_switch_systems/MELLANOX-MIB.zip>`_ , unzip it. Copy the mib file MELLANOX-MIB.txt to ``/usr/share/snmp/mibs`` directory on the mn and sn (if the sn is the snmp trap destination.)
|
||||
|
@@ -2,12 +2,12 @@ UFM Configuration
|
||||
=================
|
||||
|
||||
|
||||
UFM server are just regular Linix boxes with UFM installed. XCAT can help install and configure the UFM servers. The XCAT mn can send remote command to UFM through xdsh. It can also collect SNMP traps and syslogs from the UFM servers.
|
||||
UFM server are just regular Linux boxes with UFM installed. xCAT can help install and configure the UFM servers. The XCAT mn can send remote command to UFM through xdsh. It can also collect SNMP traps and syslogs from the UFM servers.
|
||||
|
||||
Setup xdsh to UFM and backup
|
||||
----------------------------
|
||||
|
||||
Assume we have two hosts with UFM installed, called host1 and host2. First define the two hosts in the XCAT cluster. Usually the network that the UFM hosts are in a different than the compute nodes, make sure to assign correct servicenode and xcatmaster in the noderes table. And also make sure to assign correct os and arch values in the nodetype table for the UFM hosts. For example: ::
|
||||
Assume we have two hosts with UFM installed, called host1 and host2. First define the two hosts in the xCAT cluster. Usually the network that the UFM hosts are in a different than the compute nodes, make sure to assign correct servicenode and xcatmaster in the noderes table. And also make sure to assign correct os and arch values in the nodetype table for the UFM hosts. For example: ::
|
||||
|
||||
mkdef -t node -o host1,host2 groups=ufm,all os=sles11.1 arch=x86_64 servicenode=10.0.0.1 xcatmaster=10.0.0.1
|
||||
|
||||
@@ -22,16 +22,16 @@ Now we can run xdsh on the UFM hosts. ::
|
||||
Consolidate syslogs
|
||||
-------------------
|
||||
|
||||
Run the following command to make the UFM hosts to send the syslogs to the XCAT mn: ::
|
||||
Run the following command to make the UFM hosts to send the syslogs to the xCAT mn: ::
|
||||
|
||||
updatenode ufm -P syslog
|
||||
|
||||
To test, run the following commands on the UFM hosts and see if the XCAT MN receives the new messages in /var/log/messages ::
|
||||
To test, run the following commands on the UFM hosts and see if the xCAT MN receives the new messages in /var/log/messages ::
|
||||
|
||||
logger xCAT "This is a test"
|
||||
|
||||
|
||||
Send SNMP traps to XCAT Management Node
|
||||
Send SNMP traps to xCAT Management Node
|
||||
---------------------------------------
|
||||
|
||||
You need to have the Advanced License for UFM in order to send SNMP traps.
|
||||
|
Reference in New Issue
Block a user