Instruction/ maintenance manual of the product Ethernet PCI-X Adapter Sun Microsystems
Go to page of 78
Sun Microsystems, Inc. www .sun.com Submit comments about this document at: http://www.sun.com/hwdocs/feedback Sun ™ 10-Gigabit Ether net PCI-X Adapter Installation and User’ s Guide P ar t No .
Please Recycle Copyright 2005 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved. Sun Microsystems, Inc.
iii Contents Preface xiii 1. Product Overview 1 Product Description 1 Hardware and Software Requirements 2 Features 3 2. Installing the Adapter 5 Installing the Adapter Without Dynamic Reconfiguration.
iv Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 10-Gigabit Ethernet Driver Parameter V alues and Def initions 20 Flow Control Parameters 20 Interrupt Paramet.
Contents v B. Diagnostic Software 45 SunVTS Diagnostic Software 45 Updating SunVTS to Recognize the Adapter 46 ▼ T o Update SunVTS to Recognize the Adapter 46 Using the SunVTS netlbtest 47 ▼ T o Use the netlbtest 47 C. Installing the Software Manually 49 ▼ T o Install the Driver Softwar e Manually 49 D.
vi Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005.
vii T ables T ABLE 1-1 Hardware and Software Requirements for Sun SPARC Servers 2 T ABLE 3-1 ixge Driver Parameter, Status, and Descriptions 20 T ABLE 3-2 Read-Write Flow Control Keyword Descriptions .
viii Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005.
ix Figur es FIGURE 1-1 Sun 10-Gigabit Ethernet PCI-X Adapter with Optical Transceiver Installed 2 FIGURE 1-2 Sun 10-Gigabit Ethernet PCI-X Adapter Fiber Optic Channels 3 FIGURE 4-1 Example of Servers .
x Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005.
xi Declaration of Conformity EMC USA—FCC Class A This equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions: 1. This equipment may not cause harmful interference. 2. This equipment must accept any interference that may cause undesir ed operation.
xii Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005.
xiii Pr eface The Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User ’ s Guide provides installation instructions for the Sun 10-Gigabit Ethernet PCI-X adapter .
xiv Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 Using UNIX Commands This document might not contain information on basic UNIX ® commands and procedur es such as shutting down the system, booting the system, and configuring devices.
Preface xv T ypographic Conventions Accessing Sun Documentation Y ou can view , print, or purchase a br oad selection of Sun documentation, including localized versions, at: http://www.sun.com/documentation Thir d-Party W eb Sites Sun is not responsible for the availability of third-party web sites mentioned in this document.
xvi Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 Contacting Sun T echnical Support If you have technical questions about this product that are not answered in this document, go to: http://www.
1 CHAPTER 1 Pr oduct Overview This chapter contains an overview of the Sun 10-Gigabit Ethernet PCI-X adapter , including: ■ “Product Description” on page 1 ■ “Hardwar e and Software Requir e.
2 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 FIGURE 1-1 Sun 10-Gigabit Ethernet PCI-X Adapter with Optical T ransceiver Installed Har dware and Softwar e Requir ements Before installing the adapter , make sure your system meets the requir ed hardwar e and software.
Chapter 1 Product Overview 3 FIGURE 1-2 Sun 10-Gigabit Ethernet PCI-X Adapter Fiber Optic Channels Featur es The Sun 10-Gigabit Ethernet PCI-X adapter addresses the following requir ements and provide.
4 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005.
5 CHAPTER 2 Installing the Adapter This chapter describes how to install the Sun 10-Gigabit Ethernet PCI-X adapter in your system and verify that it has been installed correctly . The chapter then describes how to install the driver software using the automated script.
6 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ▼ T o Install the Adapter The following instructions describe the basic tasks requir ed to install the adapter . Refer to your system installation or service manual for detailed PCI adapter installation instructions.
Chapter 2 Installing the Adapter 7 ▼ T o Install the Optical T ransceiver The Sun 10-Gigabit Ethernet PCI-Xadapter requires an optical transceiver to create and Ethernet connection. The optical transceiver Part Number: 135-1 172-01 is available from Sun Micr osystems.
8 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 4. Push the handle closed to lock the optical transceiver in place. 5. Detach the wrist strap. Caution – If you pull the locking handle down when the optical transceiver is installed, remove the optical transceiver entirely and r einstall it.
Chapter 2 Installing the Adapter 9 ▼ T o V erify the Hardwar e Installation After you have installed the Sun 10-Gigabit Ethernet adapter , but before you boot your system, perform the following tasks to verify the installation. Refer to the your Solaris documentation for the detailed instructions.
10 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 4. V iew the .properties f ile for a list of device properties. The . properties command displays the specific information about the installed adapter . If you are using the Sun 10-Gigabit Ethernet adapter , your output will be similar to the following: 5.
Chapter 2 Installing the Adapter 11 Installing the Adapter W ith Dynamic Reconf iguration If you have a Sun Enterprise™ system that supports dynamic reconfiguration (DR), you do not have to reboot your system after installing the adapter .
12 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ■ If your system is running Sun Enterprise V olume Manager™, it should automatically mount the CD-ROM to the /cdrom/cdrom0 directory .
Chapter 2 Installing the Adapter 13 *** Checking for correct version of 10-Gigabit Ethernet Driver Packages... *** Checking for correct version of VLAN Utility Driver Packages.
14 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 5. Reboot the system to load the driver: 6. V erify the installation to ensure that the driver installed and loaded properly .
Chapter 2 Installing the Adapter 15 Conf iguring the Network Host Files After installing the driver software, you must cr eate a hostname.ixge number file where number = the instance number of the ixge interface.) for the adapter ’s Ethernet interface.
16 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 On Linux operating systems, use the following commands: Where number corr esponds to the device instance of the Sun 10-Gigabit Ethernet PCI-X adapter you plan to configure.
Chapter 2 Installing the Adapter 17 3. Create an appropriate entry in the /etc/hosts f ile for each active ixge interface. For example: # cat /etc/hosts # # Internet host table # 127.
18 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005.
19 CHAPTER 3 Conf iguring Driver Parameters This chapter describes how to configur e the driver parameters used by the Sun 10- Gigabit Ethernet PCI-Xadapter .
20 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 10-Gigabit Ethernet Driver Parameter V alues and Def initions T ABLE 3-1 describes the parameters and settings for the ixge device driver .
Chapter 3 Configuring Dr iver P arameters 21 T ABLE 3-2 provides f low control keywords and describes their function. Interrupt Parameters T ABLE 3-3 describes the receive interrupt blanking values.
22 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 Jumbo Frames The variable accept-jumbo enables the driver to instruct the upper layers that the driver is operating in Jumbo-frame mode. Refer to the documentation that came with your switch for exact commands to configur e jumbo frames support.
Chapter 3 Configuring Dr iver P arameters 23 ▼ T o Conf igure Jumbo Frames in a Linux Envir onment 1. Ensure that the ixge software is installed. 2. Plumb the Sun 10-Gigabit Ethernet PCI-X interface: where xxx.xxx.xx.xxx = the IP addr ess of the interface.
24 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ▼ T o Specify Device Instances for the ndd Utility Before you use the ndd utility to get or set a parameter for a ixge device, you must specify the device instance for the utility .
Chapter 3 Configuring Dr iver P arameters 25 ● T o modify a parameter value, use the -set option. If you invoke the ndd utility with the -set option, the utility passes value , which must be specifi.
26 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ● T o list all the parameters supported by the ixge driver , type ? . See T ABLE 3-1 through T ABLE 3-6 for parameter descriptions. Note – By default, autonegotiation is set to off .
Chapter 3 Configuring Dr iver P arameters 27 ▼ T o Set Driver Parameters Using a ixge.conf File 1. Obtain the hardware path names for the ixge devices in the device tree. a. Check the /etc/driver_aliases f ile to identify the name associated with a particular device: Note – ixge "pci8086,1048.
28 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 In this example: ■ The first part within the double quotes specif ies the hardwar e node name in the device tree. ■ The number not enclosed in quotes is the instance number (shown in bold italics).
Chapter 3 Configuring Dr iver P arameters 29 10-Gigabit Ethernet Driver Operating Statistics These statistics are part of the statistics pr esented by the k stat command. T ABLE 3-5 describes the read-only Media Independent Interface (MII) capabilities.
30 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 T able describes the read-only ixge device capabilities. T ABLE 3-6 describes the kstat ixge:1 r eceive a nd .
Chapter 3 Configuring Dr iver P arameters 31 rx_new_pages Number of pages that got replaced during reception. rx_no_buf Number of times the hardwar e cannot receive data because ther e is no more r eceive buffer space. rx_nocanput Number of packets dropped due to full STREAMS message queue.
32 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ▼ T o Check Link Partner Settings T ype the kstat command as superuser: xcvr_id GMII/MII physical layer device Identification Decimal copy of MII registers 2 and 3.
Chapter 3 Configuring Dr iver P arameters 33 multircv 0 multixmt 0 norcvbuf 0 noxmtbuf 0 obytes 0 obytes64 0 oerrors 0 opackets 0 opackets64 0 pci_bad_ack_err 0 pci_bus_speed 100 pci_dmarz_err 0 pci_d.
34 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ▼ T o Discover Device Capabilities ● Use the kstat command to discover device capabilities.
Chapter 3 Configuring Dr iver P arameters 35 ▼ T o Discover Link Settings ● Use the kstat command to discover link settings. Conf iguration Checking The jumbo frame configuration checking occurs at Layer 2 or Layer 3, depending on the configuration method.
36 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005.
37 CHAPTER 4 Conf iguring VLANs This chapter explains V irtual Local Area Networks (VLANs) in detail and provides configuration instructions and examples.
38 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 Although VLANs are commonly used to create individual br oadcast domains and/or separate IP subnets, it can be useful for a server to have a presence on more than one VLAN simultaneously .
Chapter 4 Configuring VLANs 39 ■ VLAN 2 includes the Main Server , Clients 1 and 2 by means of a shared media segment, and Client 5. This is a software development group. ■ VLAN 3 includes the Main Server , the Accounting Server and Client 4. This is an accounting group.
40 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 subnets when setting up a VLAN network interface. This means that each VID assigned to a VLAN interface of a physical network interface will belong to different subnets.
Chapter 4 Configuring VLANs 41 2. Use the ifconfig(1M) to conf igure a VLAN virtual device, for example: The output of ifconfig -a on a system having VLAN devices ixge123000 and ixge224000 : 3. On the switch, set VLAN tagging and set VLAN ports to coincide with the VLANs you’ve set up on the server .
42 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005.
43 APPENDIX A Specif ications This appendix provides specifications for the Sun 10-Gigabit Ethernet PCI-X adapter . ■ “Performance Specifications” on page 43 ■ “Physical Characteristics” o.
44 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 Physical Characteristics Power Requir ements T ABLE A-2 Physical Characteristics Dimension Measurement Length 6.6 inches (167.64 mm) W idth 2.536 inches (64.61 mm) Height Height on component side: 0.
45 APPENDIX B Diagnostic Softwar e This appendix provides an overview of the SunVTS diagnostic application and instructions for updating the SunVTS software to r ecognize the adapter .
46 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 http://www.sun.com/products-n-solutions/hardware/docs/Software /system_administration/tools/testing_valid/sunvts/index.html Select the document for the Solaris release on your system.
Appendix B Diagnostic Software 47 Using the SunVTS netlbtest Y ou must have the Ethernet card and the device driver installed, a loopback connector in place, and Intervention mode enabled before running netlbtest .
48 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005.
49 APPENDIX C Installing the Softwar e Manually This appendix describes how to install the driver software manually . The Sun 10-Gigabit Ethernet Adapter CD contains the driver software requir ed to operate the adapter .
50 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ■ If your system is not running V olume Manager , mount the CD-ROM as follows: Y ou will see the following .
Appendix C Installing the Software Manually 51 4. Install the patch: 5. Check to see if vlan drivers are installed on the system: ■ If you are using a Solaris SP ARC system: ■ If you do not see the previous output, the VLAN Utility software is not installed on your system.
52 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ■ If your system is running Solaris 9 x86 software type the following: A menu similar to the following displays: 7.
53 APPENDIX D Installing the Sun 10-Gigabit Ethernet Device Driver on Linux Platforms This appendix explains how to install the Sun 10-Gigabit Ethernet PCI-X device driver in a Linux environment.
54 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 2. Build the man pages (optional): 3. Change to the rpm directory: ■ For RedHat, use the following command: ■ For SuSe Linux Enterprise Server , use the following command: 4.
Appendix D Installing the Sun 10-Gigabit Ether net Device Driver on Lin ux Platforms 55 7. V erify that the driver is loaded. In the following example, the ixge driver is shown in bold italic . On your system the driver will be indistinguishable from the other modules.
56 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 10. Use the ethtool command to check the parameter conf igurations that apply to the ixge driver . Setting Driver Parameters in a Linux Envir onment In a Linux operating system, the driver parameters can only be set at the time the driver is loaded.
Appendix D Installing the Sun 10-Gigabit Ether net Device Driver on Lin ux Platforms 57 ▼ T o Set ixge Parameters in a Linux Envir onment 1. Remove the Sun 10-Gigabit Ethernet PCI-X device driver , if it is already loaded.
58 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 T ABLE D-1 lists the tunable ixge driver parameters for Linux operating systems, and describes their function.
Appendix D Installing the Sun 10-Gigabit Ether net Device Driver on Lin ux Platforms 59 ▼ T o Conf igure VLANs in a Linux Envir onment 1. Ensure that the ixge module is loaded: 2. Plumb the Sun 10-Gigabit Ethernet PCI-X interface: where xxx.xxx.xx.xxx = the IP addr ess of the interface.
60 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ▼ T o Conf igure Bonding for Multiple ixge Interfaces 1. Modify /etc/modules.conf f ile by adding these lines: Where: bond0 is the bonding device. max_bonds is the number of bond interfaces to be created.
61 Index Symbols /etc/hostname.ixgenumber file 16 A assigning an IP address 15 autonegotiation setting disabling 26 C configuring device driver parameters 19 configuring the driver parameters 19 confi.
62 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005.
An important point after buying a device Sun Microsystems Ethernet PCI-X Adapter (or even before the purchase) is to read its user manual. We should do this for several simple reasons:
If you have not bought Sun Microsystems Ethernet PCI-X Adapter yet, this is a good time to familiarize yourself with the basic data on the product. First of all view first pages of the manual, you can find above. You should find there the most important technical data Sun Microsystems Ethernet PCI-X Adapter - thus you can check whether the hardware meets your expectations. When delving into next pages of the user manual, Sun Microsystems Ethernet PCI-X Adapter you will learn all the available features of the product, as well as information on its operation. The information that you get Sun Microsystems Ethernet PCI-X Adapter will certainly help you make a decision on the purchase.
If you already are a holder of Sun Microsystems Ethernet PCI-X Adapter, but have not read the manual yet, you should do it for the reasons described above. You will learn then if you properly used the available features, and whether you have not made any mistakes, which can shorten the lifetime Sun Microsystems Ethernet PCI-X Adapter.
However, one of the most important roles played by the user manual is to help in solving problems with Sun Microsystems Ethernet PCI-X Adapter. Almost always you will find there Troubleshooting, which are the most frequently occurring failures and malfunctions of the device Sun Microsystems Ethernet PCI-X Adapter along with tips on how to solve them. Even if you fail to solve the problem, the manual will show you a further procedure – contact to the customer service center or the nearest service center
