Using Sun Enterprise 10000 StarFire

Hi!

I provide some sample sessions. First, we need to switch on StarFire power supplies and log in to SSP computer as user "ssp":

12:08 pm:~ > ssh ssp@ultra5 -X
Password:
Last login: Sat Dec 23 13:37:54 2006 from 192.168.0.185
Sun Microsystems Inc.   SunOS 5.10      Generic January 2005

Please enter SUNW_HOSTNAME: 

this question is about domain (think "computer") you want to manage. I have domain "mysql", so I am going to use it:

12:08 pm:~ > ssh ssp@ultra5 -X
Password:
Last login: Sat Dec 23 13:37:54 2006 from 192.168.0.185
Sun Microsystems Inc.   SunOS 5.10      Generic January 2005

Please enter SUNW_HOSTNAME: mysql

unknown:mysql%
unknown:mysql%
unknown:mysql% fan
Error: Can't get port number to connect to SSP: ultra5. Domain: mysql
 The 'snmpd' agent may not be running.
unknown:mysql% domain_status
domain_status: This command must run on the main SSP.
unknown:mysql% 

All those errors indicate that communication with StarFire is not initialised yet. It need some time (5min maybe) and you can recognise it by noise of StarFire is doing. Ventilators go much slower when SSP gets control over it. Also just looking at end of long indicates when this happens:

unknown:mysql% tail -f $SSPVAR/adm/messages
Dec 24 12:29:07 unknown : [ID 702911 local0.info] SNMP Cannot find domain linux: timeout waiting for response from SNMP agent, check platform message file for possible SNMP agent errors
Dec 24 12:29:07 unknown SSP Startup: : [ID 702911 local0.info] domain linux is inactive, netcon_server  -r & not started
Dec 24 12:29:27 unknown syslog: [ID 702911 local0.error] fod: ERR: foMonitor.c, 504: system call failed, errno: 10
Dec 24 12:29:41 unknown : [ID 702911 local0.info] SNMP Cannot find domain mysql: timeout waiting for response from SNMP agent, check platform message file for possible SNMP agent errors
Dec 24 12:29:41 unknown SSP Startup: : [ID 702911 local0.info] domain mysql is inactive, netcon_server  -r & not started
Dec 24 12:29:41 unknown SSP Startup: : [ID 702911 local0.info] Startup of SSP as MAIN complete
Dec 24 12:29:43 unknown SSP Startup: : [ID 702911 local0.info] with SUNW_HOSTNAME = jes
Dec 24 12:29:43 unknown SSP Startup: : [ID 702911 local0.info] REstarting: snmpd with SUNW_HOSTNAME jes
Dec 24 12:29:44 unknown : [ID 702911 local0.info] SSP Startup: set_SEA_MIB: set sunSubAgentStatus.2 init failed: noSuchName 0 {1.3.6.1.4.1.42.2.15.8.1.2.2 INTEGER init}
Dec 24 12:29:44 unknown : [ID 702911 local0.info] SSP Startup: set_SEA_MIB: set sunSubAgentProcessID.2 15204 failed: noSuchName 0 {1.3.6.1.4.1.42.2.15.8.1.9.2 INTEGER 15204}
Dec 24 12:34:35 unknown SSP Startup: : [ID 702911 local0.info] Starting: fad
Dec 24 12:34:55 unknown SSP Startup: : [ID 702911 local0.info] Starting: cb_reset > /dev/null with SUNW_HOSTNAME jes
Dec 24 12:34:55 unknown syslog: [ID 702911 local0.warning] cb_reset: WARNING: cb_reset.c, 495: Resetting host jescb0
Dec 24 12:35:32 jescb0 cbe: NOTICE: MT! initiated cbe = 3.5 Dec 19 2003, Prom Version = 3.47
Dec 24 12:35:32 jescb0 cbe: NOTICE: cbe(): reboot reason is: ethernet remote
Dec 24 12:35:32 jescb0 cbe: NOTICE: cbe(): reboot reason is: Sparclite error
Dec 24 12:35:32 jescb0 cbe: NOTICE: cbe(): Waiting for connection on port 1025
Dec 24 12:36:02 unknown SSP Startup: : [ID 702911 local0.info] Starting: fod with SUNW_HOSTNAME jes
Dec 24 12:36:05 unknown SSP Startup: : [ID 702911 local0.info] The SSP's role is changing to MAIN
Dec 24 12:36:14 unknown SSP Startup: : [ID 702911 local0.info] Starting: cb_reset > /dev/null with SUNW_HOSTNAME jes
Dec 24 12:36:15 unknown syslog: [ID 702911 local0.warning] cb_reset: WARNING: cb_reset.c, 495: Resetting host jescb0
Dec 24 12:36:33 unknown syslog: [ID 702911 local0.warning] fod: WARNING: foMonitor.c, 641: Connection with the main CB gone ...
Dec 24 12:36:50 jescb0 cbe: NOTICE: MT! initiated cbe = 3.5 Dec 19 2003, Prom Version = 3.47
Dec 24 12:36:50 jescb0 cbe: NOTICE: cbe(): reboot reason is: ethernet remote
Dec 24 12:36:50 jescb0 cbe: NOTICE: cbe(): Waiting for connection on port 1025
Dec 24 12:37:03 unknown syslog: [ID 702911 local0.warning] fod: WARNING: foMonitor.c, 641: Connection with the main CB gone ...
Dec 24 12:37:21 unknown SSP Startup: : [ID 702911 local0.info] Starting: datasyncd
Dec 24 12:37:24 unknown SSP Startup: : [ID 702911 local0.info] Starting: cbs
Dec 24 12:37:27 jescb0 cbe: NOTICE: cbe(): CBS Socket connection fd 7 port 1025 established
Dec 24 12:37:28 unknown SSP Startup: : [ID 702911 local0.info] Starting: straps
Dec 24 12:37:33 unknown SSP Startup: : [ID 702911 local0.info] NOTE: Solstice Enterprise Agent (package SUNWsasnm) is installed.
Dec 24 12:37:33 unknown SSP Startup: : [ID 702911 local0.info] Starting: snmpd with SUNW_HOSTNAME jes
Dec 24 12:37:35 unknown : [ID 702911 local0.info] SSP Startup: set_SEA_MIB: set sunSubAgentStatus.2 init failed: noSuchName 0 {1.3.6.1.4.1.42.2.15.8.1.2.2 INTEGER init}
Dec 24 12:37:35 unknown : [ID 702911 local0.info] SSP Startup: set_SEA_MIB: set sunSubAgentProcessID.2 2519 failed: noSuchName 0 {1.3.6.1.4.1.42.2.15.8.1.9.2 INTEGER 2519}
Dec 24 12:37:35 unknown SSP Startup: : [ID 702911 local0.info] Starting: edd with SUNW_HOSTNAME jes
Dec 24 12:37:36 unknown actionsysclock: [ID 702911 local0.info] Fan Speed being set.
Dec 24 12:38:10 unknown actionsysclock: [ID 702911 local0.info] System clock being set.
Dec 24 12:38:19 unknown SSP Startup: : [ID 702911 local0.info] domain linux is inactive, obp_helper  -r & not started
Dec 24 12:38:20 unknown actioncb: [ID 702911 local0.info] Control board 0 VccFan voltage being set.
Dec 24 12:38:21 unknown actioncb: [ID 702911 local0.info] Control board 1 VccFan voltage being set.
Dec 24 12:38:22 unknown PowerFailRebootact: [ID 702911 local0.info] None of the domains were booted, Power Fail recovery skipped.
Dec 24 12:38:25 unknown syslog: [ID 702911 local0.warning] edd: WARNING: EDDApp.cc, 741: Edd monitoring started.
Dec 24 12:38:26 unknown SSP Startup: : [ID 702911 local0.info] domain mysql is inactive, obp_helper  -r & not started
Dec 24 12:38:26 unknown SSP Startup: : [ID 702911 local0.info] domain linux is inactive, netcon_server  -r & not started
Dec 24 12:38:30 unknown SSP Startup: : [ID 702911 local0.info] domain mysql is inactive, netcon_server  -r & not started
Dec 24 12:38:30 unknown SSP Startup: : [ID 702911 local0.info] Startup of SSP as MAIN complete
Dec 24 12:38:37 unknown BulkPowerNormact: [ID 702911 local0.info] Bulk Power Supply 2 is ON
Dec 24 12:38:37 unknown BulkPowerFailact: [ID 702911 local0.info] Bulk power supply 0 is OFF or FAILED
Dec 24 12:38:37 unknown BulkPowerFailact: [ID 702911 local0.info] Bulk power supply 1 is OFF or FAILED
Dec 24 12:38:37 unknown SystemConfChangeact: [ID 702911 local0.info] Data passed in is: confBulkPowerList.0 0-1-2-3-4-5
Dec 24 12:38:37 unknown BulkPowerFailact: [ID 702911 local0.info] Bulk power supply 5 is OFF or FAILED
Dec 24 12:38:37 unknown BulkPowerFailact: [ID 702911 local0.info] Bulk power supply 4 is OFF or FAILED
Dec 24 12:38:37 unknown BulkPowerNormact: [ID 702911 local0.info] Bulk Power Supply 3 is ON

Lot's of stuff here but note "Startup of SSP as MAIN complete". This means that SSP has full control over StarFire now.
Look for same commands now:

unknown:mysql% domain_status
DOMAIN           TYPE                      PLATFORM        OS      SYSBDS
linux            Ultra-Enterprise-10000    jes             5.10    3
mysql            Ultra-Enterprise-10000    jes             5.10    0 1 2 4 5 6 7
unknown:mysql% fan
Fan Configuration:
------------------
Number of fan trays: 14
Fan tray list: 0 1 2 3 4 5 6 7 8 9 10 11 12 13
Max fans per tray: 2
LED  per fan tray: 2
Actual fan speed: nominal

           Fan Status
-------------------------------
Tray #    Power   Fan 0   Fan 1
-------------------------------
  0         on     on      on
  1         on     on      on
  2         on     on      on
  3         on     on      on
  4         on     on      on
  5         on     on      on
  6         on     on      on
  7         on     on      on
  8         on     on      on
  9         on     on      on
 10         on     on      on
 11         on     on      on
 12         on     on      on
 13         on     on      on

unknown:mysql%       
unknown:mysql% power

Good 48V Bulk Power Supplies:                     2 3
Number of Good 48V Bulk Power Supplies:           2 (not enough)
Required 48V Power Supplies for 15 System Boards: 6
Number of Good Peripheral Cabinet Power Supplies: 0

 Centerplane Support Board Average Voltages (V):
 CSB#     5VDC Vcc HK     3.3VDC Vdd HK       3.3VDC Vdd Core
 ----  -----------------  -------------  -------------------------
  0     4.998     4.995       3.495       0.869    0.869    0.869
  1     4.991     4.995       3.510       0.865    0.865    0.865

 System Board Average Voltages (V):
      3.3VDC    5VDC     3.3VDC       VDC        5VDC
 SB#   Vdd     Vcc HK    Vdd HK     Vdd Core     Vcc
 ---  -------  -------  --------   ----------  --------
  0    0.758    5.030    3.359        0.044      0.103
  1    0.754    5.020    3.372        0.045      0.681
  2    0.601    5.052    3.339        0.376      0.635
  3    0.476    5.025    3.356        0.305      0.549
  4    0.737    5.042    3.387        0.042      0.176
  5    0.737    5.062    3.389        0.038      0.669
  6    0.718    5.081    3.384        0.043      0.664
  7    0.707    5.047    3.381        0.043      0.659
  8    0.743    5.020    3.376        0.259      0.676
  9    0.737    5.035    3.374        0.011      0.671
 11    0.742    5.030    3.359        0.012      0.091
 12    0.717    5.059    3.375        0.013      0.078
 13    0.719    5.030    3.362        0.253      0.093
 14    0.751    5.062    3.365        0.255      0.093
 15    0.724    5.064    3.337        0.253      0.674

 Control Board Average Voltages (V):
        5VDC        5VDC       3.3VDC      5VDC Vcc     5VDC
 CB#    Vcc        Vcc HK      Vdd HK     Peripheral   Vcc Fans
 ---  --------    --------    ---------   ----------  ---------
  0    5.091       5.084       3.430       5.162       5.348
  1    5.074       5.115       3.422       5.135       5.353
unknown:mysql%

It complains a lot about missing power supplies but he is bit fool. He assumes that all my system boards are fully loaded with all stuff and I am going to use them. But I have wattmeter and have much better understanding how many supplies it needs. Two is enough! Anyway, those fans take over 2KW, so I reduce them:

unknown:mysql% cat fans.sh
#!/bin/sh

fan -p on
#fan -p off -t 1
#fan -p off -t 2
#fan -p off -t 3
fan -p off -t 4
fan -p off -t 5
fan -p off -t 6
fan -p off -t 7
fan -p off -t 8
fan -p off -t 9
fan -p off -t 10
#fan -p off -t 11
fan -p off -t 12
fan -p off -t 13
fan -s nominal
unknown:mysql% fans.sh
unknown:mysql%        

Now it is time to power on domain "mysql". As I told him about "mysql" when I logged in, it knows which resources need to be powered now:

unknown:mysql% power -on
Warning: This system does not have any power supply redundancy.
Warning: Bulk power is insufficient to power all existing system boards.
Powering up centerplane: 0...done
Powering up centerplane: 1...done
Powering up system board: 0...done
Powering up system board: 1...done
Powering up system board: 2...done
Powering up system board: 4...done
Powering up system board: 5...done
Powering up system board: 6...done
Powering up system board: 7...done
unknown:mysql%

While powered, it still does not boot. We need to initiate POST and boot sequence with command "bringup". Arguments after it tell that we need to boot computer to OBP but not into operating system yet. This command is slow. Takes 15 minutes. This depends on amount of memory and CPUs to be tested. Currently I have no such power in house to feed whole computer, so I left only one CPU on each board but filled all memory slots. This monster runs with 7 CPUs and 28G of RAM under 2KW poer budget without disks. This satisfies me.

unknown:mysql% bringup -A off
Trying to get bringup.lock lock... OK
Checking that all other domains are down..  OK
Trying to set system clock...
Bringing up domain mysql
This will configure the Centerplane.  Please confirm (y/n)? y
Configuring the centerplane, POST args -C
Starting: hpost -C
Opening SNMP server library...

Significant contents of /export/home/ssp/.postrc:
#
logfile

Using blacklist file /var/opt/SUNWssp/etc/jes/blacklist
phase cplane_isolate: CP domain cluster mask clear...
phase init_reset: Initial system resets...
phase jtag_integ: JTAG probe and integrity test...
phase mem_probe: Memory dimm probe...
phase iom_probe: I/O module type probe...
phase jtag_bbsram: JTAG basic test of bootbus sram...
phase proc1: Initial processor module tests...
phase pc/cic_reg: PC and CIC register tests...
phase dtag: CIC DTAG tests...
phase mem: MC register and memory tests...
phase io: I/O controller tests...
phase procmem2: Processor vs. memory II tests...
phase lbexit: Centerplane connection tests...
phase npb_mem: Non-Proc Board MC and memory tests...
phase npb_iopc: Non-Proc Board IOPC register tests...
phase npb_io: Non-Proc Board I/O controller tests...
phase npb_cplane: Non-Proc Board centerplane connection tests...
phase nmb_procmem2: Non-Mem Board Proc vs. memory II tests...
phase final_config: Final configuration...
Configuring in 3F, FOM = 100352.00: 7 procs, 4 Scards, 28672 MBytes.
Creating OBP handoff structures...
Configured in 3F with 7 processors, 4 Scards, 28672 MBytes memory.
Interconnect       frequency is  99.902 MHz, from SNMP MIB.
Processor external frequency is 199.805 MHz, from SNMP MIB.
Processor internal frequency is 399.610 MHz, from proc clk_mode probe.
Boot processor is 0.0 = 0
POST (level=16, verbose=20, -C) execution time 9:46
Boot processor 0 written to /var/opt/SUNWssp/etc/jes/mysql/bootproc
Updating domain mysql with bootproc 0 domainInstance 1 and interrupt vector MIB...  OK
Starting obp_helper -m 0 -A off...   OK
Starting netcon_server -p 0 ...   OK
Checking boot processor signatures..  OK
unknown:mysql%

Next we need to connect console. This "netcon_server" is console server. We need to run client. BTW, we can run multiple console clients simultaneously.

unknown:mysql% netcon -g
trying to connect...
connected.
Unlocked write permission is granted.

<#0> ok banner
SUNW,Ultra-Enterprise-10000, using Network Console
OpenBoot 3.2.181, 28672 MB memory installed, Serial #10912239.
Ethernet address 0:0:be:a6:81:ef, Host ID: 80a681ef.



<#0> ok 
<#0> ok .speed
.speed ?
<#0> ok
<#0> ok boot
Boot device: /sbus@40,0/SUNW,socal@0,0/sf@0,0/ssd@w210000008704a39e,0:a  File and args:
Invalid wwn number 21000000 8704a39e

Can't open boot device

<#0> ok probe-fcal-all
/sbus@40,0/SUNW,socal@0,0/sf@1,0
loop 1 is OFFLINE
loop 1 is OFFLINE

/sbus@40,0/SUNW,socal@0,0/sf@0,0
WWN 50200200  1017b9 Loopid  1
WWN 50800200   9453b Loopid d2
0/sf@0,0/ssd@wInval/sWWN 50800200   9453b LoopidP       E8
WWN 220000008704a39e Loopid ef
  Disk     HITACHI DKR1C-J072FC    D2V5302B5351
WWN 50000870  1866dd Loopid e4
  Disk     HITACHI DKR1C-J072FC    D2V530214301
WWN 220000008700a3cd Loopid e1
  Disk     HITACHI DKR1C-J072FC    D7V530652719
WWN 22000000870632ee Loopid dc
  Disk     HITACHI DKR1C-J072FC    D2V530322118
WWN 220000008705833f Loopid d9
  Disk     HITACHI DKR1C-J072FC    D2V530313007
WWN 22000000870515f3 Loopid d5
  Disk     HITACHI DKR1C-J072FC    D7W130R16525
WWN 50800200   9453c Loopid b5
  Device type d     SUN     SENA            1.09P       E8
WWN 22000000870498ab Loopid ca
  Disk     HITACHI DKR1C-J072FC    D2V5302S8388
WWN 220000008700b8bf Loopid c9
  Disk     HITACHI DKR1C-J072FC    D2V5302X5727
WWN 220000008706321b Loopid c7
  Disk     HITACHI DKR1C-J072FC    D2V530382777
WWN 22000000870bb125 Loopid c6
  Disk     HITACHI DKR1C-J072FC    D7W1305F5983

<#0> ok boot /sbus@40,0/SUNW,socal@0,0/sf@0,0/ssd@w220000008704a39e,0:a
Boot device: /sbus@40,0/SUNW,socal@0,0/sf@0,0/ssd@w220000008704a39e,0:a  File and args:
7SunOS Release 5.10 Version Generic_118833-24 64-bit
Copyright 1983-2006 Sun Microsystems, Inc.  All rights reserved.
Use is subject to license terms.
Hostname: mysql

mysql console login:   
It works. We can try to log in and see some fancy commands people might want to use:
mysql console login: root
Password:
Last login: Fri Dec 22 13:30:02 on console
Dec 24 13:47:13 mysql login: ROOT LOGIN /dev/console
Sun Microsystems Inc.   SunOS 5.10      Generic January 2005
#
#
# prtdiag
System Configuration:  Sun Microsystems  sun4u SUNW,Ultra-Enterprise-10000
System clock frequency: 100 MHz
Memory size: 28672 Megabytes

========================= CPUs =========================

                    Run   Ecache   CPU    CPU
Brd  CPU   Module   MHz     MB    Impl.   Mask
---  ---  -------  -----  ------  ------  ----
 0     0     0      400     8,0   US-II    10.0
 1     4     0      400     8,0   US-II    10.0
 2     8     0      400     8,0   US-II    10.0
 4    16     0      400     8,0   US-II    10.0
 5    20     0      400     8,0   US-II    10.0
 6    24     0      400     8,0   US-II    10.0
 7    28     0      400     8,0   US-II    10.0


========================= Memory =========================

           Memory Units: Size
           0: MB   1: MB   2: MB   3: MB
           -----   -----   -----   -----
Board 0     1024    1024    1024    1024
Board 1     1024    1024    1024    1024
Board 2     1024    1024    1024    1024
Board 4     1024    1024    1024    1024
Board 5     1024    1024    1024    1024
Board 6     1024    1024    1024    1024
Board 7     1024    1024    1024    1024


========================= IO Cards =========================

     Bus   Freq
Brd  Type  MHz   Slot        Name                          Model
---  ----  ----  ----------  ----------------------------  --------------------
 0   SBus   25            0  SUNW,socal/sf (scsi-3)        501-5266
 0   SBus   25            0  SUNW,qfe                      SUNW,sbus-qfe
 0   SBus   25            0  SUNW,qfe                      SUNW,sbus-qfe
 0   SBus   25            0  SUNW,qfe                      SUNW,sbus-qfe
 0   SBus   25            0  SUNW,qfe                      SUNW,sbus-qfe
 0   SBus   25            1  QLGC,isp/sd (block)           QLGC,ISP1000U
 0   SBus   25            1  network                       SUNW,sbus-gem

For diagnostic information,
see /var/opt/SUNWssp/adm/mysql/messages on the SSP.
#  

Now let's try some StarFire specific features you have not seen on other E series Suns. First, I close console with sequence "~." and will be back on SSP prompt:

For diagnostic information,
see /var/opt/SUNWssp/adm/mysql/messages on the SSP.
# ~
Connection closed
unknown:mysql%     

What feature is coolest on StarFire? Dynamic recongfiguration of course! Yes it exists on lower E series but does not work that perfect! Let's try:

unknown:mysql% deleteboard -b 7

deleteboard: Domain mysql is an NGDR domain
deleteboard: Attempting to acquire DR lock
deleteboard: Attempting to initialize daemon communications
Checking environment...
Establishing Control Board Server connection...
Initializing SSP SNMP MIB...

                mysql: System Status - Summary

BOARD #: 0 1 2 4 5 6 7 being used by domain mysql
deleteboard: Testing eligibility of board 7 for detachment
deleteboard: Determining if DR daemon will allow detachment of board 7
deleteboard: Starting board drain stage for board 7
deleteboard: Starting complete detachment stage for board 7
...Checking IDN state of mysql : NOTSUPPORTED
IDN UNLINK succeeded [mysql]
Reconfiguring domain mask registers.
Processors on board 7 reset.
Board 7 placed into loopback.
Removing board 7 from domain_config file.
Board detachment completed successfully.

deleteboard: Attempting to release DR lock
deleteboard: Operation succeeded
unknown:mysql%
unknown:mysql% power -off -sb 7
Warning: This system does not have any power supply redundancy.
Warning: Bulk power is insufficient to power all existing system boards.
Powering down system board: 7...done
unknown:mysql%

This means I just removed board with 4G of RAM and one CPU from working computer! I powered it off and can physically remove it, add CPUs and return it. Let's check:

14:01 pm:~ > ssh root@mysql -X
Password:
Last login: Sun Dec 24 13:47:13 2006
Sun Microsystems Inc.   SunOS 5.10      Generic January 2005
# prtdiag
System Configuration:  Sun Microsystems  sun4u SUNW,Ultra-Enterprise-10000
System clock frequency: 100 MHz
Memory size: 24576 Megabytes

========================= CPUs =========================

                    Run   Ecache   CPU    CPU
Brd  CPU   Module   MHz     MB    Impl.   Mask
---  ---  -------  -----  ------  ------  ----
 0     0     0      400     8,0   US-II    10.0
 1     4     0      400     8,0   US-II    10.0
 2     8     0      400     8,0   US-II    10.0
 4    16     0      400     8,0   US-II    10.0
 5    20     0      400     8,0   US-II    10.0
 6    24     0      400     8,0   US-II    10.0


========================= Memory =========================

           Memory Units: Size
           0: MB   1: MB   2: MB   3: MB
           -----   -----   -----   -----
Board 0     1024    1024    1024    1024
Board 1     1024    1024    1024    1024
Board 2     1024    1024    1024    1024
Board 4     1024    1024    1024    1024
Board 5     1024    1024    1024    1024
Board 6     1024    1024    1024    1024


========================= IO Cards =========================

     Bus   Freq
Brd  Type  MHz   Slot        Name                          Model
---  ----  ----  ----------  ----------------------------  --------------------
 0   SBus   25            0  SUNW,socal/sf (scsi-3)        501-5266
 0   SBus   25            0  SUNW,qfe                      SUNW,sbus-qfe
 0   SBus   25            0  SUNW,qfe                      SUNW,sbus-qfe
 0   SBus   25            0  SUNW,qfe                      SUNW,sbus-qfe
 0   SBus   25            0  SUNW,qfe                      SUNW,sbus-qfe
 0   SBus   25            1  QLGC,isp/sd (block)           QLGC,ISP1000U
 0   SBus   25            1  network                       SUNW,sbus-gem

For diagnostic information,
see /var/opt/SUNWssp/adm/mysql/messages on the SSP.
# 

Notice that board 7 is gone! Now we return it:

unknown:mysql% addboard -d mysql -b 7

addboard: Domain mysql is an NGDR domain
addboard: Attempting to acquire DR lock
addboard: Attempting to initialize daemon communications
Checking environment...
Establishing Control Board Server connection...
Initializing SSP SNMP MIB...

                mysql: System Status - Summary

BOARD #: 7 8 physically present
BOARD #: 0 1 2 4 5 6 being used by domain mysql
addboard: Testing eligibility of board 7 for attachment
addboard: Starting initial attachment stage for board 7
Initiate board attachment, board 7 to domain mysql.
Adding board 7 to domain_config file.
/opt/SUNWssp/bin/hpost -H80,0
Opening SNMP server library...

Significant contents of /export/home/ssp/.postrc:
#
logfile

Using blacklist file /var/opt/SUNWssp/etc/jes/blacklist
Reading centerplane asics to obtain bus configuration...
Bus configuration determined to be 3F.
phase cplane_isolate: CP domain cluster mask clear...
phase init_reset: Initial system resets...
phase jtag_integ: JTAG probe and integrity test...
phase mem_probe: Memory dimm probe...
phase iom_probe: I/O module type probe...
phase jtag_bbsram: JTAG basic test of bootbus sram...
phase proc1: Initial processor module tests...
phase pc/cic_reg: PC and CIC register tests...
phase dtag: CIC DTAG tests...
phase mem: MC register and memory tests...
phase io: I/O controller tests...
phase procmem2: Processor vs. memory II tests...
phase lbexit: Centerplane connection tests...
phase npb_mem: Non-Proc Board MC and memory tests...
phase npb_iopc: Non-Proc Board IOPC register tests...
phase npb_io: Non-Proc Board I/O controller tests...
phase npb_cplane: Non-Proc Board centerplane connection tests...
phase nmb_procmem2: Non-Mem Board Proc vs. memory II tests...
phase final_config: Final configuration...
Configuring in 3F, FOM = 512.00: 1 proc, 0 Scards, 4096 MBytes.
Creating OBP handoff structures...
Configured in 3F with 1 processor, 0 Scards, 4096 MBytes memory.
Interconnect       frequency is  99.902 MHz, from SNMP MIB.
Processor external frequency is 199.805 MHz, from SNMP MIB.
Processor internal frequency is 399.610 MHz, from proc clk_mode probe.
Boot processor is 7.0 = 28
POST (level=16, verbose=20, -H0080,0) execution time 5:01
hpost is complete.
/opt/SUNWssp/bin/obp_helper -H -m28
Board debut complete.
Reconfiguring domain mask registers.
Probing board resources.
Board attachment initiated successfully.

Ready to COMPLETE board attachment.

addboard: Starting complete attachment stage for board 7
Completing attach for board 7.
...Checking IDN state of mysql : NOTSUPPORTED
IDN UNLINK succeeded [mysql]
Board attachment completed successfully.

addboard: Attempting to release DR lock
addboard: Operation succeeded
unknown:mysql%

Combining this ability with ability to separate single hardware into "domains" makes StarFire very special. This makes possible to reassign resources (which are very expensive) to system which needs it. You can take CPU power off from production system and assign it to test system at night for making stress tests for example. Also it makes possible to test IT system under different configurations without rebooting it.

It is possible to switch off domains and other stuff from SSP. Next command will shut down running domains and will physically flip power thumblers on StarFire to "off" position:

unknown:mysql% power -off -B
Warning: This system does not have any power supply redundancy.
Warning: Bulk power is insufficient to power all existing system boards.
Powering down system board: 0...done
Powering down system board: 1...done
Powering down system board: 2...done
Powering down system board: 3...done
Powering down system board: 4...done
Powering down system board: 5...done
Powering down system board: 6...done
Powering down system board: 7...done
Powering down system board: 8...done
Powering down system board: 9...done
Powering down system board: 11...done
Powering down system board: 12...done
Powering down system board: 13...done
Powering down system board: 14...done
Powering down system board: 15...done
Powering down centerplane: 0...done
Powering down centerplane: 1...done

WARNING: When the 48V power supplies are turned OFF, the only way to power
         them back on is by manually flipping the corresponding 48V power
         supply breakers ON.

Do you want to continue? (y/n) y
done
done
Powering down bulk power supply: 2...done
Powering down bulk power supply: 3...done
done
done
done
done
unknown:mysql%        

I will make some stuff how to make it work. Some QuickStart. I think for now it is enough. My linux running attempts with Aurora 2.0 and Gentoo 2006.x are here:

http://no.spam.ee/~tonu/sparc/gentooe10k.txt

http://no.spam.ee/~tonu/sparc/aurorae10k.txt

I also provide shell access for people with any serious intention. But please understand that this computer is in my bedroom and making noise of jet engine. I do not run it 24x7.

back to StarFire home

back to home