This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
supermicro_ipmi_v2.0_on_ubuntu [2007/01/12 14:23] adam |
supermicro_ipmi_v2.0_on_ubuntu [2016/11/25 22:38] (current) |
||
---|---|---|---|
Line 1: | Line 1: | ||
- | ===== Running IPMI on Supermicro Servers | + | ===== Running IPMI on Linux ===== |
- | IPMI is standard which allows remote server management. IPMI cards, known as Baseboard Management Cards (BMCs) are primitive computers in their own right and are operational all the time, so long as the server has a power source. The server itself does not need to be powered on, or the operating system operational for the BMC to work. | + | ==== What is IPMI? ==== |
+ | |||
+ | |||
+ | IPMI is standard which allows remote server management, primarliy developed by Intel. IPMI cards, known as Baseboard Management Cards (BMCs) are primitive computers in their own right and are operational all the time, so long as the server has a power source. The server itself does not need to be powered on, or the operating system operational for the BMC to work. | ||
The primary benefits of IPMI are: | The primary benefits of IPMI are: | ||
Line 8: | Line 11: | ||
* Ability to remotely power on, power off, reboot the server and flash the identification light. | * Ability to remotely power on, power off, reboot the server and flash the identification light. | ||
* Ability to set up a console on a serial port and have the BMC redirect that console over a network port, which in cooperation with BIOS level console redirection, | * Ability to set up a console on a serial port and have the BMC redirect that console over a network port, which in cooperation with BIOS level console redirection, | ||
+ | |||
+ | ==== IPMI Revisions ==== | ||
There are currently 3 IPMI revisions: | There are currently 3 IPMI revisions: | ||
Line 17: | Line 22: | ||
SOL is desirable as it allows you to interact with the server as though it were local in cases where the operating system locks up and SSH or telnet access are not available due to the operating system being inoperable. IPMI v1.5 still allows to you to power the system on and off and view sensor output. | SOL is desirable as it allows you to interact with the server as though it were local in cases where the operating system locks up and SSH or telnet access are not available due to the operating system being inoperable. IPMI v1.5 still allows to you to power the system on and off and view sensor output. | ||
- | More details to come on actually setting IPMI up, this is simply a beginning to the article. | + | ==== Installation ==== |
- | Links: | + | This guide covers the installation of IPMI tools on Dell 1425 servers and Supermicro servers with a PDSMi+ motherboard. The instructions will be relevent for other server models, but I make no promises. |
+ | |||
+ | For Supermicros servers, open up the server chassis and make a note of the MAC address on the IPMI port, you'll need this later. | ||
+ | |||
+ | In the BIOS, set the concole redirection to COM2, which is the BMC console port, it doesn' | ||
+ | |||
+ | Supermicro BMCs require you to boot from a CD and use their tool to flash the BMC prior to use, refer to the FTP link below and go up a few directories to get the latest IPMI CD image (the one shipped with the server caused me problems). Burn the image to a CD and boot from it. Use the utility to install the firmware for your IPMI version and then your motherboard version. I had to guess whether to use RCMP+ or RCMP. I have the [[http:// | ||
+ | |||
+ | Once this step is done, hit CTRL-Alt-Del and remove the CD. | ||
+ | |||
+ | For Dell 1425 servers (and probably other Dells), hit Alt-3 when prompted to enter the BMC setup and give it some unique network settings and some user settings (make your passwords secure!). | ||
+ | |||
+ | You can boot now into Linux, or from a Linux installer CD. | ||
+ | |||
+ | Note on network configuration: | ||
+ | |||
+ | Both Dell 1425s and Supermicro PDSMi+ motherboards use the first LAN port to redirect the IPMI traffic over when using SOL. For this reason, whether you intend to use SOL or not, it is a good idea to use the first LAN ports, almost certainly eth0, as your local network interface, rather than an Internet visible interface. | ||
+ | |||
+ | Once booted into Linux, install openipmi on all machines with a BMC and ipmitool on every machine from which you wish to run IPMI commands locally or to send IPMI commands to a remote machine. Red Hat, FC and SUSE users will have to download the IPMItool packages from the website if they' | ||
+ | |||
+ | For kernel 2.6.x | ||
+ | |||
+ | modprobe ipmi_msghandler | ||
+ | modprobe ipmi_devintf | ||
+ | modprobe ipmi_si type=kcs ports=0xca8 regspacings=4 | ||
+ | |||
+ | If ipmi_si won't load, look at the output of dmidecode for the base address of your IPMI BMC and then use that base address for the ports=< | ||
+ | |||
+ | Kernel 2.4 people will have to follow the Debian IPMI instructions, | ||
+ | |||
+ | If this works without errors, add the modules and options to / | ||
+ | |||
+ | If you then cat / | ||
+ | |||
+ | ==== IPMI Commands ==== | ||
+ | |||
+ | You should then be able to run some IPMI commands locally (probably need to be root as root owns the device node): | ||
+ | |||
+ | '' | ||
+ | Chassis Power is on | ||
+ | root@gw01: | ||
+ | System Power : on | ||
+ | Power Overload | ||
+ | Power Interlock | ||
+ | Main Power Fault : false | ||
+ | Power Control Fault : false | ||
+ | Power Restore Policy : always-off | ||
+ | Last Power Event : | ||
+ | Chassis Intrusion | ||
+ | Front-Panel Lockout | ||
+ | Drive Fault : false | ||
+ | Cooling/Fan Fault : false | ||
+ | Sleep Button Disable : allowed | ||
+ | Diag Button Disable | ||
+ | Reset Button Disable : allowed | ||
+ | Power Button Disable : allowed | ||
+ | Sleep Button Disabled: true | ||
+ | Diag Button Disabled : true | ||
+ | Reset Button Disabled: true | ||
+ | Power Button Disabled: true'' | ||
+ | |||
+ | Command dissection: | ||
+ | |||
+ | ipmitool -I open chassis power status | ||
+ | |||
+ | -I open - use the local openipmi interface. | ||
+ | chassis | ||
+ | power - run a command relating to power. | ||
+ | status | ||
+ | |||
+ | Thats pretty simple. | ||
+ | |||
+ | Assuming you get a local response, then try a remote command from another machine, you won't need to be root as you are talking to the BMC directly, rather than through the OS. | ||
+ | |||
+ | '' | ||
+ | Password: | ||
+ | Chassis Power is on | ||
+ | adam@ns0:~$ ipmitool -I lan -H 192.168.10.123 -U root -a chassis status | ||
+ | Password: | ||
+ | System Power : on | ||
+ | Power Overload | ||
+ | Power Interlock | ||
+ | Main Power Fault : false | ||
+ | Power Control Fault : false | ||
+ | Power Restore Policy : always-off | ||
+ | Last Power Event : | ||
+ | Chassis Intrusion | ||
+ | Front-Panel Lockout | ||
+ | Drive Fault : false | ||
+ | Cooling/Fan Fault : false | ||
+ | Sleep Button Disable : allowed | ||
+ | Diag Button Disable | ||
+ | Reset Button Disable : allowed | ||
+ | Power Button Disable : allowed | ||
+ | Sleep Button Disabled: true | ||
+ | Diag Button Disabled : true | ||
+ | Reset Button Disabled: true | ||
+ | Power Button Disabled: true'' | ||
+ | |||
+ | Command dissection: | ||
+ | |||
+ | ipmitool -I lan -H 192.168.10.123 -U ipmiadmin -a chassis power status | ||
+ | |||
+ | -I lan - Run the command over the LAN. | ||
+ | -H 192.168.10.123 | ||
+ | -U root - -U specifies a user, followed by the username set up on the BMC, not a local or remote OS user. | ||
+ | -a - prompt for password. | ||
+ | chassis power status | ||
+ | |||
+ | If that all works for you then you can a woop and a holler. | ||
+ | |||
+ | IPMItool has a familiar UNIX or Cisco IOS syntax, which allows you to complete the command as you go along. If you type in an incomplete command, IPMItool will provide you with a list of options that can be used to complete your command. | ||
+ | |||
+ | Simply typing ipmitool -I open will offer the top-level sub-commands, | ||
+ | |||
+ | '' | ||
+ | No command provided! | ||
+ | Commands: | ||
+ | raw Send a RAW IPMI request and print response | ||
+ | i2c Send an I2C Master Write-Read command and print response | ||
+ | lan | ||
+ | chassis | ||
+ | event Send pre-defined events to MC | ||
+ | mc Management Controller status and global enables | ||
+ | sdr Print Sensor Data Repository entries and readings | ||
+ | sensor | ||
+ | fru Print built-in FRU and scan SDR for FRU locators | ||
+ | sel Print System Event Log (SEL) | ||
+ | pef | ||
+ | sol | ||
+ | isol Configure IPMIv1.5 Serial-over-LAN | ||
+ | user Configure Management Controller users | ||
+ | channel | ||
+ | session | ||
+ | sunoem | ||
+ | shell | ||
+ | exec Run list of commands from file | ||
+ | set Set runtime variable for shell and exec | ||
+ | root@gw01: | ||
+ | User Commands: summary [< | ||
+ | | ||
+ | set name < | ||
+ | set password <user id> [< | ||
+ | | ||
+ | | ||
+ | | ||
+ | root@gw01: | ||
+ | Chassis Commands: | ||
+ | root@gw01: | ||
+ | chassis power Commands: status, on, off, cycle, reset, diag, soft'' | ||
+ | |||
+ | ...And so on. | ||
+ | |||
+ | Beware, powering the server off or rebooting does not do a graceful shutdown like the OS would. They are the same as holding in the power button or pressing the reboot button. Supermicro offer a graceful shutdown daemon for Windows and Linux which will respond to the graceful showdown and reboot | ||
+ | commands provided by Supermicro' | ||
+ | |||
+ | More details to come on actually setting IPMI up, this is simply a terse beginning to the article. | ||
+ | |||
+ | ==== Links ==== | ||
+ | |||
+ | === IPMI Standards === | ||
+ | |||
+ | [[http:// | ||
+ | |||
+ | [[http:// | ||
+ | |||
+ | === IPMI Software === | ||
+ | |||
+ | [[http:// | ||
+ | |||
+ | [[http:// | ||
+ | |||
+ | [[https:// | ||
+ | |||
+ | === IPMI Software Documentation === | ||
+ | |||
+ | [[http:// | ||
+ | |||
+ | [[http:// | ||
+ | |||
+ | === IPMI Howtos === | ||
[[http:// | [[http:// | ||
Line 26: | Line 211: | ||
[[http:// | [[http:// | ||
+ | |||
+ | [[http:// | ||
+ | |||
+ | === Vendor IPMI Documentation === | ||
+ | |||
+ | [[http:// | ||
+ | |||
+ | === Other IPMI Documentation === | ||
+ | |||
+ | [[http:// | ||
[[ftp:// | [[ftp:// | ||
+ | |||
+ | === Related Documentation === | ||
[[http:// | [[http:// | ||
+ | ==== Todo ==== | ||
+ | |||
+ | * Tidy up command and output examples' | ||
+ | * Include glossary of terms and IPMI version details | ||
+ | * Include relevent info instead of referring to other docs in case they disappear, such as kernel 2.4 info from Debian howto | ||
+ | * Cover serial consoles, grub, innitab etc | ||
+ | * Cover IPMIView and Graceful Showdown Daemon | ||
+ | * Link to Supermicro docs, tools and CD images more accurately | ||