Friday, 16 August 2013

Update

This Blog does not include any confidential information / data of any customer environment. In addition this blog is only for technical discussion and is not related to any customer site, location, machine name, data center's name.

please contact me at rahuls.tsm2006@gmail.com for your feedback and suggestion.

Wednesday, 14 August 2013

TDP Option File Error during Oracle Backup ;SBT error = 7011, errno = 2534, sbtopen: system error



I found this issue when dealing with Oracle DB backup where backup of multiple DB instances failed with SBT error = 7011, errno = 2534, sbtopen: system error.

Symptoms:

Database Buffers 327680000 bytes
Redo Buffers 532480 bytes
Database mounted.
SQL> Disconnected from Oracle8i Enterprise Edition Release <Release Number>
With the Partitioning option

Enterprise Edition Release <Release Number> 

===========================================================================================
Starting rman whole backup for <DB Instance Name> Level 2 Wed Jul 31 23:02:11 METDST 2013
===========================================================================================
Oracle8i

Recovery Manager: Release Enterprise Edition Release <Release Number> 

RMAN-06005: connected to target database: <Instance name>

(DBID=ID_Number)
RMAN-06008: connected to recovery catalog database

RMAN> 2> 3> 4> 5> 6>
RMAN-03022: compiling command: allocate
RMAN-03023: executing command: allocate
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03007: retryable error occurred during execution of command: allocate
RMAN-07004: unhandled exception during command execution on channel t1
RMAN-10035: exception raised in RPC: ORA-19554: error allocating device, device type: SBT_TAPE, device name:
ORA-19557: device error, device type: SBT_TAPE, device name:
ORA-27000: skgfqsbi: failed to initialize storage subsystem (SBT) layer
HP-UX Error: 2534: Unknown system error
Additional information: 7011
ORA-19511: SBT error = 7011, errno = 2534, sbtopen: system error
RMAN-10031: ORA-19624 occurred during call to DBMS_BACKUP_RESTORE.DEVICEALLOCATE
==================================


 We notice that In Script to run the Oracle offline DB backup , the path to TDP Oracle option file was not correctly mentioned which leads to option file error.

SBT error = 7011, errno = 2534, The error 2534 correspond to the TDP message =>

ANU2534E Option file error

We checked in RMAN script that  $TDP8i_DIR is not set to tdpo option file under /usr/tivoli/tsm/client/oracle/bin64 instead it was set to /usr/tivoli/tsm/client/oracle/bin.


/usr/tivoli/tsm/client/oracle/bin64 # cd $TDP8i_DIR
/usr/bin/ksh: /usr/tivoli/tsm/client/oracle/bin:  not found.

Solution: Set the correct path of tdpo option file in parameter $TDP8i_DIR so that it should look for tdpo option file under usr/tivoli/tsm/client/oracle/bin64.

You can also use tdpoconf showenv -tdpo_optfile=/location of opt file/ to see if there is any issue.

Archive log not found during oracle DB backup


I notice an issue with TDP for Oracle where the COLD DB backup + Archive failed with below error.


Starting backup at Aug 13 2013 02:47:08
ORACLE error from target database:
ORA-00258: manual archiving in NOARCHIVELOG mode must identify log

allocated channel: ORA_SBT_TAPE_1
channel ORA_SBT_TAPE_1: SID=130 device type=SBT_TAPE
channel ORA_SBT_TAPE_1: Data Protection for Oracle: version<version detais>
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03002: failure of backup plus archivelog command at 08/13/2013 02:47:09
RMAN-06059: expected archived log not found, loss of archived log compromises recoverability
ORA-19625: error identifying file /Path/to/oracle/archlog/<log_file_name.arc
ORA-27037: unable to obtain file status
IBM AIX RISC System/6000 Error: 2: No such file or directory
Additional information: 3




===================================

The above error means there is a problem with Archive log file.

First we should check the log file under given location /Path/to/oracle/archlog

--------------------------------------
//Path/to/oracle/archlog # ls -ltr Log name_96_1_822820066.arc
Log name_96_1_822820066.arc  not found
-------------------------------------

This means that during backup RMAN is looking for a log which does not exist. It may be possible the this log might have been deleted accidently by DBA, but since log file not found backup can not be completed. Here are some possible solutions:


1- Ask your DBA to do a crosscheck of backup ( using RMAN command) which will check the status of log and mark it expire or tell the catalog to NOT ask for this log during recovery time.

command >
RMAN> crosscheck backup;

specification does not match any backup in the repository


2- Check the size of FS which may lead to this issue.

run  df -g ( in AIX) to check the size of FS used. If FS is 100 %, make sure you have enough space in FS to have a backup.



Wednesday, 7 August 2013

Dear TSM Admins,


"I dedicate this blog to all TSM administrators and experts"


Presenting TSM blog where you can share your queries and relative answers of Tivoli Storage Manager /IBM Spectrum protect.

So, we are waiting for your inputs and suggestions ...!

Thanks !
Rahul Sharma
TSM expert and Author