Supermicro 6016GT-TF User Manual Page 1

SUPERSUPERSERVER 6016XT-TFSUPERSERVER 6016GT-TFSUPERSERVER 6016GT-TF-TM2SUPERSERVER 6016GT-TF-TC2®USER’S MANUALRevision 1.0a

1-2SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's Manual1-2 Serverboard FeaturesAt the heart of the SuperServer 6016XT-TF/6016GT-TF/6016GT-

A-2SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualNotes

Appendix B: Installing WindowsB-1Appendix B Installing Windows After all hardware components have been installed, you must fi rst confi gure Intel South

B-2SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualB-2 Installing Windows for a Non-RAID SystemInsert Microsoft's Windows XP/Win

C-1Appendix C: System Specifi cationsAppendix C System Specifi cationsProcessors Two Intel Xeon 5600/5500 series processors Note: Please ref

C-2SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualServerboard X8DTG-DF (proprietary ATX form factor) Dimensions: 16.64&q

C-3Appendix C: System Specifi cationsSafety: CSA/EN/IEC/UL 60950-1 Compliant, UL or CSA Listed (USA and Canada), CE Marking (Europe)California Best Man

C-4SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's Manual(continued from front)The products sold by Supermicro are not intended for and will

1-3Chapter 1: IntroductionIPMIIPMI (Intelligent Platform Management Interface) is a hardware-level interface speci-fi cation that provides remote acces

1-4SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's Manual1-4 GPU SubsystemThe 6016GT family of servers represents Supermicro's line of

1-5Chapter 1: IntroductionFigure 1-1. Intel 5520 Chipset: System Block DiagramNote: This is a general block diagram. Please see Chapter 5 for details.

1-6SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's Manual1-5 Contacting SupermicroHeadquartersAddress: Super Micro Computer, Inc.980 Rock A

Chapter 2: Server Installation2-1Chapter 2 Server Installation2-1 OverviewThis chapter provides a quick setup checklist to get your SuperServer up and

2-2SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's Manual!!Warnings and Precautions!This product is not suitable for use with visual display

Chapter 2: Server Installation2-3Always keep the rack's front door and all panels and components on the servers • closed when not servicing to ma

2-4SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's Manual2-4 Installing the System into a RackThis section provides information on installi

Chapter 2: Server Installation2-5Figure 2-2. Installing the Inner Rails111213Installing the Inner Rail ExtensionsThe SC818G chassis includes a set of

The information in this User’s Manual has been carefully reviewed and is believed to be accurate. The vendor assumes no responsibility for any inaccur

2-6SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualFigure 2-3. Assembling the Outer RailsAssembling the Outer RailsEach outer rail is

Chapter 2: Server Installation2-7Figure 2-4. Installing the Outer Rails to the RackInstalling the Outer Rails onto the RackOuter Rail InstallationAdju

2-8SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualFigure 2-5. Installing the Server into a RackInstalling the Chassis into a Rack (F

Chapter 2: Server Installation2-9Installing the Server into a Telco RackOptional brackets (p/n MCP-290-00016-0N) are needed to install the server to a

2-10SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's Manual2-5 Checking the Serverboard SetupAfter you install the server in the rack, you w

Chapter 2: Server Installation2-11Checking the ComponentsYou may have processors already installed to the serverboard. Each proces-1. sor needs its ow

2-12SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualProviding PowerThe last thing you must do is to provide input power to the system.

Chapter 3: System Interface3-1PowerThe main power button is used to apply or remove power from the power supply to the server system. Turning off syst

3-2SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualFigure 3-1. Universal Information LED StatesNote: deactivating the UID LED must be

Chapter 3: System Interface3-313-4 SATA Drive Carrier LEDsGreen:• Each Serial ATA drive carrier has a green LED. When illuminated, this green LED (

PrefaceAbout This ManualThis manual is written for professional system integrators and PC technicians. It provides information for the installation an

3-4SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualNotes

Chapter 4: System Safety4-1Chapter 4 System Safety4-1 Electrical Safety Precautions!Basic electrical safety precautions shall be followed to protect

4-2SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's Manual4-2 General Safety PrecautionsFollow these rules to ensure general safety:Keep the

Chapter 4: System Safety4-34-3 ESD PrecautionsElectrostatic Discharge (ESD) is generated by two objects with different electrical charges coming into

4-4SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's Manual4-4 Operating PrecautionsCare must be taken to assure that the chassis cover is in

Chapter 5: Advanced Serverboard Setup5-1Chapter 5 Advanced Serverboard SetupThis chapter covers the steps required to install the X8DTG-DF serverboard

5-2SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualUnpackingThe serverboard is shipped in antistatic packaging to avoid electrical st

Chapter 5: Advanced Serverboard Setup5-35-3 Connecting CablesNow that the serverboard is installed, the next step is to connect the cables to the boar

5-4SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's Manual1875 6432IO Ports1 USB Port 0 5 LAN Port 22 USB Port 1 6 COM Port3 IPMI Dedicated L

Chapter 5: Advanced Serverboard Setup5-55-5 Installing the Processor and Heatsink!Avoid placing direct pressure to the top of the processor package.

SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualivChapter 5: Advanced Serverboard SetupChapter 5 provides detailed information on the

5-6SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualAfter removing the plastic cap, use 1. your thumb and the index fi nger to hold the

Chapter 5: Advanced Serverboard Setup5-7Remove power from the system 1. and unplug the AC power cord from the power supply.Do not apply any thermal gr

5-8SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualMemory SupportThe X8DTG-DF supports up to 192 GB of registered ECC or up to 48 GB o

Chapter 5: Advanced Serverboard Setup5-9DIMM Population TableDIMM Slots per ChannelDIMMs Populated per ChannelDIMM Type (Reg.= Registered)Speeds (in M

5-10SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's Manual5-6 Adding PCI Add-On CardsThe 6016XT-TF (without GPUs installed) can support fou

Chapter 5: Advanced Serverboard Setup5-11Figure 5-5. X8DTG-DF Layout(not drawn to scale)5-7 Serverboard DetailsNotesJumpers not indicated are for test

5-12SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualX8DTG-DF Quick ReferenceJumper Description Default SettingJBMC1 BMC (Baseboard Man

Chapter 5: Advanced Serverboard Setup5-13Power Button ConnectorThe PW_ON connector is on pins 1 and 2 of JF1. Momentarily contacting both pins will po

5-14SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualNIC2 LEDPin Defi nitions (JF1)Pin# Defi nition 9 Vcc10 GroundNIC2 (JLAN2) LE

Chapter 5: Advanced Serverboard Setup5-15HDD/FP UID ButtonThe HDD/UID button connections are located on pins 13/14 of JF1. Attach a hard-drive LED cab

vPrefaceNotes

5-16SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualLAN1/2 (Ethernet Ports) Two Ethernet ports (designated LAN1 and LAN2) are located

Chapter 5: Advanced Serverboard Setup5-17IPMB A System Management Bus header for the IPMI is located at IPMB. Connect the ap-propriate cable here to u

5-18SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualInternal SpeakerAttach a speaker to the JSPK1 pins to provide audible alarms for t

Chapter 5: Advanced Serverboard Setup5-195-9 Jumper SettingsExplanation of JumpersTo modify the operation of the serverboard, jumpers can be used to c

5-20SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualLAN1/2 Enable/Disable Change the setting of jumper JPL1 to en-able or disable the

Chapter 5: Advanced Serverboard Setup5-215-10 Onboard IndicatorsLAN1/2 LEDsThe Ethernet ports have two LEDs. On each port, one LED indicates activity

5-22SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's Manual5-11 SATA PortsSATA PortsThere are no jumpers to confi gure the onboard SATA conne

Chapter 5: Advanced Serverboard Setup5-235-12 Installing SoftwareAfter the hardware has been installed, you should fi rst install the operating system

5-24SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualSupero Doctor IIIThe Supero Doctor III program is a web-based management tool that

Chapter 5: Advanced Serverboard Setup5-25Note: SD III Software Revision 1.0 can be downloaded from our Web Site at: ftp://ftp.supermicro.com/utility/S

viTable of ContentsChapter 1 Introduction1-1 Overview ...

5-26SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualNotes

Chapter 6: Advanced Chassis Setup6-1Chapter 6 Advanced Chassis SetupThis chapter covers the steps required to install components and perform mainte-na

6-2SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualFigure 6-1. Chassis: Front and Rear Views6-2 Control PanelThe control panel (locat

Chapter 6: Advanced Chassis Setup6-3System Fan FailureFan speed is controlled by system temperature via a BIOS setting. If a fan fails, the remaining

6-4SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's Manual6-4 Drive Bay Installation/RemovalAccessing the Drive BaysHard Drives: Because of

Chapter 6: Advanced Chassis Setup6-5Figure 6-3. Removing a Hard Drive CarrierWarning: Except for short periods of time (swapping hard drives), do not

6-6SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualInstalling a Hard Drive to the Hard Drive CarrierRemove the two screws securing the

Chapter 6: Advanced Chassis Setup6-7Note: When installing the hard drive carrier that is next to the power supply, the power supply handle must be lif

6-8SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's Manual6-5 Installing the Air ShroudAir shrouds concentrate airfl ow to maximize fan effi c

Chapter 6: Advanced Chassis Setup6-96-6 Power SupplyThe system includes a single 1400 watt power supply, which is auto-switching capa-ble. Power must

viiTable of Contents2-5 Checking the Serverboard Setup ... 2-102-6 Checking the Drive

6-10SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualNotes

Chapter 7: BIOS7-1Chapter 7 BIOS 7-1 IntroductionThis chapter describes the AMI BIOS Setup Utility for the X8DTG-DF. The AMI ROM BIOS is stored in a F

7-2SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualStarting the Setup UtilityNormally, the only visible Power-On Self-Test (POST) rout

Chapter 7: BIOS7-3Supermicro X8DTG-DFBIOS Build Version• : This item displays the BIOS revision used in your sys-tem.BIOS Build Date• : This item di

7-4SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's Manual7-3 Advanced Setup Confi gurationsUse the arrow keys to select Boot Setup and hit &

Chapter 7: BIOS7-5Hit 'Del' Message DisplayThis feature displays "Press DEL to run Setup" during POST. The options are Enabled and

7-6SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualC1E SupportSelect Enabled to use the feature of Enhanced Halt State. C1E signifi can

Chapter 7: BIOS7-7tion and heat dissipation. Please refer to Intel’s web site for detailed information. The options are Disable (Disable GV3) and Ena

7-8SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualQPI L0s and L1This enables the QPI power state to low power. L0s and L1 are automat

Chapter 7: BIOS7-9Guardband TemperatureThis is the temperature which applies to the DIMM temperature threshold. Each step is in 0.5oC increment. The

viii5-10 Onboard Indicators ... 5-215-11 SATA Ports ...

7-10SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualIntel VT-dSelect Enabled to enable Intel's Virtualization Technology support

Chapter 7: BIOS7-11Hand-Off support. When enabled, the EHCI Interface will be changed from the BIOS-controlled to the OS-controlled. The options are D

7-12SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualPrimary IDE Master/Slave, Secondary IDE Master/Slave, Third IDE Master, and Fourth

Chapter 7: BIOS7-13Select 4 to allow the AMI BIOS to use PIO mode 4. It has a data transfer band-width of 32-Bits. Select Enabled to enable 32-Bit da

7-14SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's Manualthe S.M.A.R.T. Select Enabled to allow the AMI BIOS to use the S.M.A.R.T. to suppo

Chapter 7: BIOS7-15as its I/O port address and IRQ 4 for the interrupt address. The options for Serial Port1 are Disabled, 3F8/IRQ4, 3E8/IRQ4, 2E8/IRQ

7-16SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualXHardware Health MonitorThis feature allows the user to monitor system health and

Chapter 7: BIOS7-17Supermicro has leveraged this feature by assigning a temperature status to certain thermal conditions in the processor (Low, Medium

7-18SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualFan1 ~ Fan 4 ReadingThis feature displays the fan speed readings from fan interfac

Chapter 7: BIOS7-19Status of BMCBaseboard Management Controller (BMC) manages the interface between system management software and platform hardware.

Chapter 1 Introduction1-1 OverviewThe SuperServer 6016XT-TF/6016GT-TF/6016GT-TF-TM2/6016GT-TF-TC2 is a GPU-optimized supercomputing server comprised o

7-20SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualTotal Number of Entries• SEL Entry Number• SEL Record ID• SEL Record Type• Timesta

Chapter 7: BIOS7-21Channel Number - Enter the channel number for the SET LAN Confi g com-mand. This is initially set to [1]. Press "+" or &

7-22SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualParameter SelectorUse this feature to select the parameter of your IP Address confi

Chapter 7: BIOS7-23XSEL PEF Confi gurationSet PEF Confi gurationSet this feature to confi gure the Platform Event Filter (PEF). PEF interprets BMC events

7-24SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualEvent Message for PEF Action - This enables of disables Event Messages for PEF act

Chapter 7: BIOS7-257-4 Security SettingsThe AMI BIOS provides a Supervisor and a User password. If you use both pass-words, the Supervisor password mu

7-26SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualClear User Password (Available only when User Password has been set)This item allo

Chapter 7: BIOS7-27XHard Disk DrivesThis feature allows the user to specify the boot sequence from all available hard disk drives. The settings are Di

7-28SUPERSERVER 6016XT-TF/6016GT-TF/TF-TM2/TF-TC2 User's ManualSave Changes and ExitWhen you have completed the system confi guration changes, sel

A-1Appendix A: BIOS Error Beep CodesAppendix A BIOS Error Beep Codes During the POST (Power-On Self-Test) routines, which are performed each time the