Cell Server Administration
For a half rack we have 7 cells.
Each cell has 12 disks
Each disk contains:
A cell disk which contains:
A number of Grid disks
which each contain an ASM disk.
Â
Cell alerts can be raised by Exacheck, check on the cell using cellcli
e.g.
oracle> ssh celladmin@cell01-mgmt
cellcli
cellcli> list alerthistory where alerttype=’stateless’
Clear alerts:
cellcli> alter alerthistory ,,
examinedby=””
ASM details do not appear in “list griddisk” details
CELLCLI> list griddisk DATA_CD_01_ detail
:
available to:
:
CELLCLI> alter cell restart service cellsrv
CELL-02620 – unmapped CELLSRV
DELLCLI> alter cell restart services ms
To list the cells in use run the following against an ASM instance
SQL> select distinct substr(path,3,13) from v$asm_disk;
This will list the IP addresses of the cell servers.
Â
Â
$ ssh -l root
$ cellcli
cellcli> list cell detail
cellcli> list physicaldisk
cellcli> list celldisk
cellcli> list physicaldisk detail
cellcli> liist celldisk detail
cellcli> liist griddisk detail
cellcli> list alerthistory where alerttype=’stateless’
OR from the db server
$ dcli -g cells -l celladmin cellcli -e list cell detail
Â
EXAMPLE 1:
MISSING DISK BECAUSE OF INCORRECT SIZINGS
in ASM
SQL> select group_number, name from v$asm_diskgroup;
1 DATA
2 SYS
3 RECO
Â
SQL> select group_number, substr(path,1,15), count(1) from v$asm_disk group by group_number, substr(path,1,15);
GROUP_NUMBER SUBSTR(path,1,15) COUNT
============================
1 o/192.168.10.1 12
1 o/192.168.10.2 12
1 o/192.168.10.3 12
1 o/192.168.10.4 12
1 o/192.168.10.5 12
1 o/192.168.10.6 12
1 o/192.168.10.7 12
2 o/192.168.10.1 12
2 o/192.168.10.2 12
2 o/192.168.10.3 11
2 o/192.168.10.4 12
2 o/192.168.10.5 12
2 o/192.168.10.6 12
2 o/192.168.10.7 12
3 o/192.168.10.1 12
3 o/192.168.10.2 12
3 o/192.168.10.3 12
3 o/192.168.10.4 12
3 o/192.168.10.5 12
3 o/192.168.10.6 12
3 o/192.168.10.7 12
Therefore the SYS group is missing one disk on 192.168.10.3
Run cellcli on that cell server
cellcli> list griddisk
SYS_DG_CD_01_ active
SYS_DG_CD_02_ active
*** disk 3 is missing
SYS_DG_CD_04_ active
etc
Trying to recreate the volume gives errors:
cellcli> create griddisk SYS_DG_CD_03_ cellDisk=CD_03_
CELL-02566: No space for the specified allocation.
Investigating further shows that one of the RECO disks is incorrectly sized:
cellcli> list griddisk RECO_CD_02_ detail
name:RECO_CD_02_
asmDiskgroupName:Â RECO
asmDiskName:Â Â Â Â Â Â Â Â Â RECO_CD_02_
:
size:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â 164G (whereas all the others are 105G)
Â
RESIZE the disk
SQL> alter diskgroup RECO drop disk RECO_CD_03_;
CELLCLI> drop griddisk RECO_CD_03_
In case of issues whilst its being removed form the disk group try again
CELLCLI> drop griddisk RECO_CD_03_
CELLCLI> create griddisk RECO_CD_03_ cellDisk=CD_03_, size=105G
SQL> alter diskgroup add disk ‘o/192.168.10.3/RECO_CD_03_‘ name RECO_CD_03_;
Now we should be able to create the SYS disk
CELLCLI> create griddisk SYS_DG_CD_03_ cellDisk=CD_03_
SQL> alter diskgroup SYS_DG add disk ‘o/192.168.1.3/SYS_DG_CD_ name SYS_DG_CD_03_;
Â
EXAMPLE 2:
RECREATING A DISK REPLACED BY ORACLE ENGINEERS
Create the CELLDISK
CellCLI> CREATE CELLDISK CD_07_ physicalDisk=’nm76dks’
CELL-04527: Cannot complete the creation of cell disk CD_07_wycexacel10mgmt. Received error: CELL-04539: Cannot create Single Disk LUN on physical disk 14:7 because there is already a LUN on this physical disk.
CellCLI> list PHYSICALDISK nm76dks detail
name:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â 14:7
deviceId:Â Â Â Â Â Â Â Â Â Â Â Â Â Â 21
diskType:Â Â Â Â Â Â Â Â Â Â Â Â Â Â HardDisk
enclosureDeviceId:Â Â Â Â Â 14
errMediaCount:Â Â Â Â Â Â Â Â Â 0
errOtherCount:Â Â Â Â Â Â Â Â Â 0
foreignState:Â Â Â Â Â Â Â Â Â Â false
luns:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â 0_7
makeModel:Â Â Â Â Â Â Â Â Â Â Â Â Â “HITACHI HUS1560SCSUN600G”
physicalFirmware:Â Â Â Â Â Â A6C0
physicalInsertTime:Â Â Â Â 2012-12-05T10:23:36+00:00
physicalInterface:Â Â Â Â Â sas
physicalSerial:Â Â Â Â Â Â Â Â nm76dks
physicalSize:Â Â Â Â Â Â Â Â Â Â 558.9109999993816G
slotNumber:Â Â Â Â Â Â Â Â Â Â Â Â 7
status:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â normal
CellCLI> CREATE CELLDISK CD_07_ lun=0_7
CellDisk CD_07_ successfully created
CellCLI> list CELLDISK CD_07_ detail
name:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â CD_07_
comment:
creationTime:Â Â Â Â Â Â Â Â Â Â 2012-12-05T13:35:11+00:00
deviceName:Â Â Â Â Â Â Â Â Â Â Â Â /dev/sdac
devicePartition:Â Â Â Â Â Â Â /dev/sdac
diskType:Â Â Â Â Â Â Â Â Â Â Â Â Â Â HardDisk
errorCount:Â Â Â Â Â Â Â Â Â Â Â Â 0
freeSpace:Â Â Â Â Â Â Â Â Â Â Â Â Â 556.8125G
freeSpaceMap:Â Â Â Â Â Â Â Â Â Â offset=32M,size=19.96875G
offset=20.015625G,size=537.84375G
id:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â 9b43a158-567e-4071-b267-576305a7f957
interleaving:Â Â Â Â Â Â Â Â Â Â none
lun:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â 0_7
physicalDisk:Â Â Â Â Â Â Â Â Â Â nm76dks
raidLevel:Â Â Â Â Â Â Â Â Â Â Â Â Â 0
size:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â 557G
status:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â normal
Â
Create the Griddisks
CellCLI> create griddisk DATA_CD_07_ cellDisk= CD_07_, size=423G
GridDisk DATA_DG_CD_07_ successfully created
Â
CellCLI> create griddisk RECO_CD_07_ cellDisk= CD_07_, size=105G
GridDisk RECO_DG_CD_07_ successfully created
Â
CellCLI> create griddisk DBFS_DG_CD_07_ cellDisk= CD_07_, size= 29G
GridDisk DBFS_DG_CD_07_wycexacel01mgmt successfully created
The sizes can be found from list existing disks for the same group.
Â
Create the ASM disks
Example syntax
SQL> alter diskgroup SYS_DG add disk ‘o/192.168.10.3/SYS_DG_CD_03_‘ name SYS_DG_CD_03_;
Restart the Cell Server when ASM doesn’t appear in “list griddisk” output.
CellCLI> list griddisk DATA_CD_07_ detail
name:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â DATA_CD_07_
availableTo:
cachingPolicy:Â Â Â Â Â Â Â Â Â default
cellDisk:Â Â Â Â Â Â Â Â Â Â Â Â Â Â CD_07_
comment:
creationTime:Â Â Â Â Â Â Â Â Â Â 2012-12-05T13:51:14+00:00
diskType:Â Â Â Â Â Â Â Â Â Â Â Â Â Â HardDisk
errorCount:Â Â Â Â Â Â Â Â Â Â Â Â 0
id:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â d875363f-1f96-44a9-8488-9a1ab595e137
offset:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â 32M
size:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â 423G
status:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â active
CellCLI> alter cell restart services cellsrv
CellCLI> list griddisk DATA_CD_07_ detail
name:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â DATA_CD_07_
asmDiskgroupName:Â Â Â Â Â Â DATA
asmDiskName:Â Â Â Â Â Â Â Â Â Â Â DATA_CD_07_
asmFailGroupName:Â Â Â Â Â Â
availableTo:
cachingPolicy:Â Â Â Â Â Â Â Â Â default
cellDisk:Â Â Â Â Â Â Â Â Â Â Â Â Â Â CD_07_
comment:
creationTime:Â Â Â Â Â Â Â Â Â Â 2012-12-05T13:51:14+00:00
diskType:Â Â Â Â Â Â Â Â Â Â Â Â Â Â HardDisk
errorCount:Â Â Â Â Â Â Â Â Â Â Â Â 0
id:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â d875363f-1f96-44a9-8488-9a1ab595e137
offset:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â 32M
size:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â 423G
status:Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â active
Â
UNMAPPED CELLSRV ERROR
CELL-02620: An unmapped CELLSRV error has occurred. The internale message is: msosscommerr#3.
WORKAROUND:
cellcli> alter cell restart service ms
Â
Â
Â
Â
Â
Â
Discussion ¬