Adam Sweet's Wiki

User Tools

Site Tools

Trace:
supermicro_ipmi_v2.0_on_ubuntu

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
supermicro_ipmi_v2.0_on_ubuntu [2007/01/12 15:56]
adam 		supermicro_ipmi_v2.0_on_ubuntu [2016/11/25 22:38] (current)
Line 1: Line 1:
-===== Running IPMI on Supermicro Servers =====+===== Running IPMI on Linux =====
  
-IPMI is standard which allows remote server management. IPMI cards, known as Baseboard Management Cards (BMCs) are primitive computers in their own right and are operational all the time, so long as the server has a power source. The server itself does not need to be powered on, or the operating system operational for the BMC to work.+==== What is IPMI? ==== 
 + 
 + 
 +IPMI is standard which allows remote server management, primarliy developed by Intel. IPMI cards, known as Baseboard Management Cards (BMCs) are primitive computers in their own right and are operational all the time, so long as the server has a power source. The server itself does not need to be powered on, or the operating system operational for the BMC to work.
  
 The primary benefits of IPMI are: The primary benefits of IPMI are:
Line 8: Line 11:
   * Ability to remotely power on, power off, reboot the server and flash the identification light.   * Ability to remotely power on, power off, reboot the server and flash the identification light.
   * Ability to set up a console on a serial port and have the BMC redirect that console over a network port, which in cooperation with BIOS level console redirection, gives you the ability to view the BIOS, bootloader, bootup and shutdown procedures and console output should the machine hang or lock up, just as you would if you were interacting with the machine locally. This is called Serial Over Lan (SOL) and is available in IPMI v2.0 as a standard and using non-standard proprietary methods in v1.5.   * Ability to set up a console on a serial port and have the BMC redirect that console over a network port, which in cooperation with BIOS level console redirection, gives you the ability to view the BIOS, bootloader, bootup and shutdown procedures and console output should the machine hang or lock up, just as you would if you were interacting with the machine locally. This is called Serial Over Lan (SOL) and is available in IPMI v2.0 as a standard and using non-standard proprietary methods in v1.5.
 +
 +==== IPMI Revisions ====
  
 There are currently 3 IPMI revisions: There are currently 3 IPMI revisions:
Line 17: Line 22:
 SOL is desirable as it allows you to interact with the server as though it were local in cases where the operating system locks up and SSH or telnet access are not available due to the operating system being inoperable. IPMI v1.5 still allows to you to power the system on and off and view sensor output. SOL is desirable as it allows you to interact with the server as though it were local in cases where the operating system locks up and SSH or telnet access are not available due to the operating system being inoperable. IPMI v1.5 still allows to you to power the system on and off and view sensor output.
  
-Terse install guide:+==== Installation ==== 
 + 
 +This guide covers the installation of IPMI tools on Dell 1425 servers and Supermicro servers with a PDSMi+ motherboard. The instructions will be relevent for other server models, but I make no promises.
  
 For Supermicros servers, open up the server chassis and make a note of the MAC address on the IPMI port, you'll need this later. For Supermicros servers, open up the server chassis and make a note of the MAC address on the IPMI port, you'll need this later.
Line 24: Line 31:
  
 Supermicro BMCs require you to boot from a CD and use their tool to flash the BMC prior to use, refer to the FTP link below and go up a few directories to get the latest IPMI CD image (the one shipped with the server caused me problems). Burn the image to a CD and boot from it. Use the utility to install the firmware for your IPMI version and then your motherboard version. I had to guess whether to use RCMP+ or RCMP. I have the [[http://www.supermicro.com/products/accessories/addon/AOC-IPMI20-E.cfm|Supermicro AOC-IPMI20-E]] and it wouldn't work with RCMP+, even though it will upload a firmware for you. It worked after I reflashed it with the RCMP version. When the process finished, use the ipnmac utility while still booted from the CD, by typing ipnmac (if you're not in the right directory you'll have to navigate using cd and dir commands to find it). Give it a unique IP address from any other interface on the machine or on your network. The BMC needs to be network addressable in its own right. Also give it the MAC address you took from the IPMI socket on the motherboard, not the one written on the LAN ports as suggested by the official Supermicro docs. Supermicro BMCs require you to boot from a CD and use their tool to flash the BMC prior to use, refer to the FTP link below and go up a few directories to get the latest IPMI CD image (the one shipped with the server caused me problems). Burn the image to a CD and boot from it. Use the utility to install the firmware for your IPMI version and then your motherboard version. I had to guess whether to use RCMP+ or RCMP. I have the [[http://www.supermicro.com/products/accessories/addon/AOC-IPMI20-E.cfm|Supermicro AOC-IPMI20-E]] and it wouldn't work with RCMP+, even though it will upload a firmware for you. It worked after I reflashed it with the RCMP version. When the process finished, use the ipnmac utility while still booted from the CD, by typing ipnmac (if you're not in the right directory you'll have to navigate using cd and dir commands to find it). Give it a unique IP address from any other interface on the machine or on your network. The BMC needs to be network addressable in its own right. Also give it the MAC address you took from the IPMI socket on the motherboard, not the one written on the LAN ports as suggested by the official Supermicro docs.
 +
 +Once this step is done, hit CTRL-Alt-Del and remove the CD.
  
 For Dell 1425 servers (and probably other Dells), hit Alt-3 when prompted to enter the BMC setup and give it some unique network settings and some user settings (make your passwords secure!). For Dell 1425 servers (and probably other Dells), hit Alt-3 when prompted to enter the BMC setup and give it some unique network settings and some user settings (make your passwords secure!).
  
-Once this step is done, hit CTRL-Alt-Del and remove the CD. You can boot into Linux, or from a Linux installer CD.+You can boot now into Linux, or from a Linux installer CD. 
 + 
 +Note on network configuration: 
 + 
 +Both Dell 1425s and Supermicro PDSMi+ motherboards use the first LAN port to redirect the IPMI traffic over when using SOL. For this reason, whether you intend to use SOL or not, it is a good idea to use the first LAN ports, almost certainly eth0, as your local network interface, rather than an Internet visible interface.
  
 Once booted into Linux, install openipmi on all machines with a BMC and ipmitool on every machine from which you wish to run IPMI commands locally or to send IPMI commands to a remote machine. Red Hat, FC and SUSE users will have to download the IPMItool packages from the website if they're not in your package-shallow distros ;). OpenIPMI is not required on machines without a BMC to send ipmi commands to remote machines. You only need OpenIPMI where you want to run IPMI commands locally, manage the BMC locally from the OS (which you want to do if you have a BMC in the machine) or I presume to do console redirection over the BMC. Once booted into Linux, install openipmi on all machines with a BMC and ipmitool on every machine from which you wish to run IPMI commands locally or to send IPMI commands to a remote machine. Red Hat, FC and SUSE users will have to download the IPMItool packages from the website if they're not in your package-shallow distros ;). OpenIPMI is not required on machines without a BMC to send ipmi commands to remote machines. You only need OpenIPMI where you want to run IPMI commands locally, manage the BMC locally from the OS (which you want to do if you have a BMC in the machine) or I presume to do console redirection over the BMC.
Line 44: Line 57:
  
 If you then cat /proc/devices, you should see your IPMI device listed and ls -l /dev/ipmi0 should show your device node. If you then cat /proc/devices, you should see your IPMI device listed and ls -l /dev/ipmi0 should show your device node.
 +
 +==== IPMI Commands ====
  
 You should then be able to run some IPMI commands locally (probably need to be root as root owns the device node): You should then be able to run some IPMI commands locally (probably need to be root as root owns the device node):
Line 167: Line 182:
 More details to come on actually setting IPMI up, this is simply a terse beginning to the article. More details to come on actually setting IPMI up, this is simply a terse beginning to the article.
  
-Links:+==== Links ====
  
-[[http://ipmitool.sourceforge.net/|IPMItool]]+=== IPMI Standards ===
  
-[[http://ipmitool.sourceforge.net/manpage.html/|IPMItool Manual]]+[[http://www.intel.com/design/servers/ipmi/index.htm|Intel IPMI page]] 
 + 
 +[[http://www.intel.com/design/servers/ipmi/ipmi.htm|Intel IPMI Standards Page]] 
 + 
 +=== IPMI Software === 
 + 
 +[[http://ipmitool.sourceforge.net/|IPMItool]]
  
 [[http://openipmi.sourceforge.net/|OpenIPMI]] Linux IPMI kernel module support [[http://openipmi.sourceforge.net/|OpenIPMI]] Linux IPMI kernel module support
 +
 +[[https://uimon.cern.ch/twiki/pub/FIOgroup/TsiIpmiPrb/ipmicli-sm|Link to Supermicro patched version of IPMItool]]
 +
 +=== IPMI Software Documentation ===
 +
 +[[http://ipmitool.sourceforge.net/manpage.html/|IPMItool Manual]]
  
 [[http://openipmi.sourceforge.net/IPMI.txt|OpenIPMI kernel module options]] [[http://openipmi.sourceforge.net/IPMI.txt|OpenIPMI kernel module options]]
 +
 +=== IPMI Howtos ===
  
 [[http://buttersideup.com/docs/howto/IPMI_on_Debian.html|Debian IPMI howto]] [[http://buttersideup.com/docs/howto/IPMI_on_Debian.html|Debian IPMI howto]]
Line 184: Line 213:
  
 [[http://www.comunidelchianti.it/~max/cern/ipmi/node24.html|Another Linux IPMI doc]] [[http://www.comunidelchianti.it/~max/cern/ipmi/node24.html|Another Linux IPMI doc]]
 +
 +=== Vendor IPMI Documentation ===
  
 [[http://www.dell.com/downloads/global/power/ps4q04-20040204-Murphy.pdf|Dell IPMI howto]] Contains useful sample commands. [[http://www.dell.com/downloads/global/power/ps4q04-20040204-Murphy.pdf|Dell IPMI howto]] Contains useful sample commands.
  
-[[http://mascanc.web.cern.ch/mascanc/c5.pdf|Cern IPMI presentation]] PDF containing some intersting info on IPMI, including reference to a version of IPMItool patched by Supermicro.+=== Other IPMI Documentation ===
  
-[[https://uimon.cern.ch/twiki/pub/FIOgroup/TsiIpmiPrb/ipmicli-sm|Link to Supermicro patched version of IPMItool]]+[[http://mascanc.web.cern.ch/mascanc/c5.pdf|Cern IPMI presentation]] PDF containing demonstration of IPMI usage, including reference to a version of IPMItool patched by Supermicro.
  
 [[ftp://ftp.supermicro.com/CDR-0010_2.03_for_IPMI_Server_Managment/IPMI_Solution/Linux/|Supermicro FTP server, Linux IPMI directory]] (version number in URL subject to change) [[ftp://ftp.supermicro.com/CDR-0010_2.03_for_IPMI_Server_Managment/IPMI_Solution/Linux/|Supermicro FTP server, Linux IPMI directory]] (version number in URL subject to change)
  
-[[http://tldp.org/HOWTO/Remote-Serial-Console-HOWTO/|Linux Remote Serial Console Howto]]+=== Related Documentation ===
  
 +[[http://tldp.org/HOWTO/Remote-Serial-Console-HOWTO/|Linux Remote Serial Console Howto]]
  
 ==== Todo ==== ==== Todo ====
  
-  * Include relevent info instead of referring to other docs in case they disappear+  * Tidy up command and output examples' formatting, they are currently all over the place 
 +  * Include glossary of terms and IPMI version details 
 +  * Include relevent info instead of referring to other docs in case they disappear, such as kernel 2.4 info from Debian howto
   * Cover serial consoles, grub, innitab etc   * Cover serial consoles, grub, innitab etc
   * Cover IPMIView and Graceful Showdown Daemon   * Cover IPMIView and Graceful Showdown Daemon
   * Link to Supermicro docs, tools and CD images more accurately   * Link to Supermicro docs, tools and CD images more accurately
  
supermicro_ipmi_v2.0_on_ubuntu.1168617402.txt.gz · Last modified: 2016/11/25 22:38 (external edit)

Page Tools

Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
CC Attribution-Share Alike 4.0 International Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki