A Step-By-Step Disaster Recovery Blueprint & Best Practices for Your NetBackup Appliances & Beyond (Onsite/Offsite)

In this technical session we will share a few customer tested blueprints for implementing DR strategies with NetBackup appliances showing support for onsite and offsite disaster recovery. This includes the architecture design with Symantec best practices, down to execution of the wizards and command lines needed to implement the solution.

Watch the recording of this Google+ Hangout: http://bit.ly/13oTjvp

1. 1
A Step-By-Step Disaster Recovery
Blueprint & Best Practices for Your
NetBackup Appliances & Beyond
(Onsite/Offsite)
A Step-By-Step Disaster Recovery Blueprint

2. Panel Members:
• Dave Little, Distinguished Systems Engineer
• Ramin Arvand, Lead Principal Technical Architect
• Tim Burlowski, Sr. Product Manager, NBU Appliances
• Hai Nguyen, Sr. Product Manager , NBU Appliances
• Alex Sakaguchi, Product Marketing Manager

2 A Step-By-Step Disaster Recovery Blueprint

3. Submit your comments and questions:
•Via Twitter using the hashtag:



•Via the Google+ Event page:
A Step-By-Step Disaster Recovery Blueprint 3
#SYMCHangout
http://bit.ly/13oTjvp

4. Goals & Objectives

A Step-By-Step Disaster Recovery Blueprint 4
1- Help you establish a stronger last line
of defense for 52X0 appliances DR
procedures.

2- Define, what is possible, what is not
possible and where to go for more help
when it comes to a 52X0 series
appliance disaster recovery procedures.

3- Recovery procedures from OST disk
devices are all the same with a minor
NBU command option difference.

5. Storage Life Cycle Policy (SLP)/Optimized Duplication




A Step-By-Step Disaster Recovery Blueprint 5
NBU Master
Domain A
NBU Media
Server
Open Storage
Device
Image
Backup
Duplication
Image
OpenStorage
device
Image
OST Optimized
Duplication

With OpenStorage, NetBackup sees disk as disk and
knows about the advanced capabilities

NetBackup OpenStorage provides
tighter integration,
richer features, better solution

6. AIR
Under Hood Diagram
A Step-By-Step Disaster Recovery Blueprint 6 10GB E Network
10GB E Network Production Data
Center Disaster Recovery
Data Center
Colorado DC
NetBackup Master
DR NetBackup Master
OPS Center
Netbackup
Lan Clients
Netbackup
Lan Clients
A.I.RImage Image Image Image
Netbackup 5220 Appliance
Media/Storage Server
Cloud GW
Netbackup 5220 Appliance
Media/Storage Server
Cloud GW
DR Netbackup 5220
Appliance
Media/Storage Server
Cloud GW
Copy 1 Copy 2
Alabama DC
OST image replication
(OST Optimized
Duplication)
NetBackup Storage
Lifecycle Polices control
the replication from
Alabama Domain to
Colorado Domain and
once the image is
automatically imported by
Policy, the Colorado
Domain copy is managed
by that domain
AIR “Import” is
a) Immediate
and
b) Optimized
(fast) operation

7. Which one to use?
AIR or Opt Dup
A Step-By-Step Disaster Recovery Blueprint 7
1- When it comes to protecting NB
clients data, configure A.I.R across your
sites.

2- When it comes to protecting NB
catalog of a Master appliance, configure
optimized duplication across your sites.

3- When it comes to protecting 52X0
appliances configured as media servers,
no NetBackup catalog recovery is
required on the Media server appliances
during DR.

8. Media Server DR Scenarios

A Step-By-Step Disaster Recovery Blueprint 8
Storage Layout &
Troubleshooting
5220
controller
RAID
PORT 1


8 4 2


8 4 2

PORT 2

8G

FC

PORT 1


8 4 2


8 4 2

PORT 2

8G

FC

PORT 1


8 4 2


8 4 2

PORT 2

8G

FC

PORT 1


8 4 2


8 4 2

PORT 2

8G

FC

8G

FC

GRN 10G

A CT/ LINK A

GRN 10G

A CT/ LINK B

10G

NIC

GRN 10G

A CT/ LINK A

GRN 10G

A CT/ LINK B

5230
NetBackup 5220 NetBackup 5230
Same storage capacity options
8 CPU cores “Westmere” 12 CPU cores “Sandy Bridge”
48/96 GB RAM 64/128 GB RAM
4 PCIe 2.0 slots 5 PCIe 3.0 slots
Broader I/O configuration
Data RAID 6
Hot Swappable
Data RAID 6
Hot Swappable
OS RAID 1 OS RAID 1
Hot Swappable
LI-ON RAID
Write Cache protection
Super Cap/NVRAM RAID
Write Cache protection

9. Submit your comments and questions:
•Via Twitter using the hashtag:



•Via the Google+ Event page:
A Step-By-Step Disaster Recovery Blueprint 9
#SYMCHangout
http://bit.ly/13oTjvp

10. Master appliance Recovery at Production Site

A Step-By-Step Disaster Recovery Blueprint 10
Customer Environment Note1: Appliance
setup so that the Hot-Catalog backups are
written to an Appliance Storage Server
device and then the image is duplicated to
DR remote location via an SLP
configuration.

11. How To Read NB Catalog DR File
A Step-By-Step Disaster Recovery Blueprint 11
DR_MEDIA_REC 2 0 0 nb5220dc 2 1 0 0 0 0 0 0 6 35 0
1353982384 @aaaak
1;PureDisk;NB5020DR;NB5020DRDP;PureDiskVolume;0
*
The names of the storage server and disk
pool that will be created in next steps need
to match the production environment. If
there are any questions of what these
names were the DR file can be used to
identify those names.
From this DR file the following items are pointed out:
Storage server type = PureDisk
Storage Server name = NB5020DR
Disk pool name = NB5020DRDP

12. Procedures for Master Appliance Server Recovery
At Local Production Site
(Applicable for Any OpenStorage Target)
A Step-By-Step Disaster Recovery Blueprint 12
1)Configure the role of Master Appliance
2)Configure the role of Recovery Media Server
3)Configure Recovery Storage Server
4)Configure a Disk Pool on Recovery Storage Server
5)Configure a DSTU
6)Run nbcatsync to synchronize DR file
7)Tune NetBackup for faster recovery (Buffer Files)
8)Run bprecover
Glossary
Recovery Media Server = 5220 Appliance that holds Catalog backup
Recovery Storage Server = 5220 Appliance that holds Catalog backup
FQDN = Fully Qualified Domain Name
nbcatsync = Reconciles the disk media ID information held in the meta-data of the NetBackup
image database with the disk media ID information found in the NetBackup EMM database.
bprecover = Recovers selected NetBackup related catalogs

13. Procedures for Master Appliance Server Recovery
at Local Production Site
A Step-By-Step Disaster Recovery Blueprint 13
1. Configure the role of Master Appliance using CLISH

Login to the appliance as admin and run the following command
Main_Menu>Appliance>Master



2. Configure the role of Recovery Media Server using CLISH

Login to the master server appliance and run the following command:
Main_Menu>Appliance>Add <media server appliance name>

The above command will add the media server appliance as SERVER in bp.conf file & performs
below EMM command on the master server

nbemmcmd -addhost -machinename XXX -machinetype media -masterserver XXX -
netbackupversion 7.5.0.4 -operatingsystem linux
http://www.symantec.com/docs/TECH163230 is available for more information.

14. A Step-By-Step Disaster Recovery Blueprint 14



3.Configure Recovery Storage Server
(using the same name as in production)

Procedures for Master Appliance Server Recovery
At Local Production Site
NB CLI ‘s - NB appliances
nbdevconfig -creatests --storage_server nb5220 -stype PureDisk -media_server nb5220
tpconfig -add -stype PureDisk -storage_server abc-01 -sts_user_id root -password root

For 3
rd
party OST, make sure OST plug-in has been installed and configured
nbdevconfig -creatests -st 9 -storage_server SSS -stype DataDomain -media_server XXX
tpconfig -add -storage_server SSS -stype DataDomain -sts_user_id boostuser -password cccc

15. A Step-By-Step Disaster Recovery Blueprint 15
4.Create the Disk Pool on Recovery Storage Server
(using the disk pool wizard and the same name as in production)











Procedures for Master Appliance Server Recovery
At Local Production Site
5. Configure DSTU

16. 16


6. Run nbcatsync to synchronize the disaster recovery
file to the new disk pool

Procedures for Master Appliance Server Recovery
At Local Production Site
nbcatsync -sync_dr_file /tmp/DR/NBU_Catalog_1358360205_FULL -copy 1 –dryrun
nbcatsync -sync_dr_file /tmp/DR/NBU_Catalog_1358360205_FULL -copy 1
A Step-By-Step Disaster Recovery Blueprint

17. 17


6. Run nbcatsync to synchronize the disaster recovery
file to the new disk pool

Procedures for Master Appliance
Server Recovery
At Local Production Site
nbcatsync -sync_dr_file /tmp/DR/NBU_Catalog_1358360205_FULL -copy 1 –dryrun
nbcatsync -sync_dr_file /tmp/DR/NBU_Catalog_1358360205_FULL -copy 1
A Step-By-Step Disaster Recovery Blueprint

18. A Step-By-Step Disaster Recovery Blueprint 18

Procedures for Master Appliance Server Recovery
At Local Production Site


7. Tune NetBackup for faster recovery
These touch files will be in /usr/openv/netbackup/db/config

echo 262144 > SIZE_DATA_BUFFERS
echo 256 > NUMBER_DATA_BUFFERS
echo 1048576 > SIZE_DATA_BUFFERS_DISK
echo 512 > NUMBER_DATA_BUFFERS_DISK

For more information, please study
“Symantec NetBackup™ Backup Planning and Performance Tuning Guide”

19. A Step-By-Step Disaster Recovery Blueprint 19
8. Run bprecover

Procedures for Master Appliance Server Recovery
At Local Production Site
NB CLI: /usr/openv/netbackup/bin/admincmd/bprecover –wizard

20. A Step-By-Step Disaster Recovery Blueprint 20


















Standby NB DR Master
other physical clients
Copy 2
DR Copy
NB Primary Master
Copy 1

Procedures for Master appliance Recovery at
Remote site

21. Procedures for Master appliance Server Recovery
At Remote DR site
(Applicable for Any OpenStorage Target)
A Step-By-Step Disaster Recovery Blueprint 21
1)Configure the role of Master Appliance
2)Configure the role of Recovery Media Server
3)Configure Recovery Storage Server
4)Configure a Disk Pool on Recovery Storage Server
5)Configure a DSTU
6)Run nbcatsync to synchronize DR file *
7)Tune NetBackup for faster recovery (Buffer Files)
8)Run bprecover

22. Procedures for Master Appliance Server Recovery
At Remote DR site
(Applicable for Any OpenStorage Target)
A Step-By-Step Disaster Recovery Blueprint 22


6. Run nbcatsync to synchronize the disaster recovery
file to the new disk pool
nbcatsync -sync_dr_file /tmp/DR/NBU_Catalog_1358360205_FULL -copy 2 –dryrun
nbcatsync -sync_dr_file /tmp/DR/NBU_Catalog_1358360205_FULL -copy 2

23. SLP/AIR Reporting: OpsCenter
SLP Inflow/Outflow Trend Report
23
Must monitor to ensure that the Green line
isn’t growing faster than the red line. In this
case, duplications are falling behind

24. Submit your comments and questions:
•Via Twitter using the hashtag:



•Via the Google+ Event page:
A Step-By-Step Disaster Recovery Blueprint 24
#SYMCHangout
http://bit.ly/13oTjvp

25. NetBackup Appliances DR Best Practices
25
Document All Appliance Recovery Procedures (Site Specific Step–By–Step)

Re-visit Recovery Point Objectives (RPOs) and Recovery Time Objectives
(RTOs) to ensure recovery per real business requirements

OpsCenter is your friend. Use it to monitor progress of SLPs.

Configure IPMI

Enable Call Home

Store NB Catalog DR File Off-Site

Create Checkpoint Before Applying Maintenance Patches





A Step-By-Step Disaster Recovery Blueprint

26. 26
In the past disaster recovery could be overwhelming, but with the current
capabilities of NetBackup and our appliances, this has been greatly
simplified.

Call to Action – Document and test your Disaster Recovery Plan!
A Step-By-Step Disaster Recovery Blueprint

27. Upcoming Virtual Vision Sessions
Date Sessions [Wed. @ 9:30 am Pacific Time]
7/24/2013 Managing Dark Data and File Governance
7/31/2013 The New Era of Business Continuity
8/7/2013
BONUS SESSION: Backing up vCloud Director | What's the
difference between the vCD API and VADP?
8/14/2013
What Can the Backup Exec 3600 do to Improve your Data
Protection Strategy?
8/21/2013
Why Host-Based SSDs are Critical for SLAs in Mission-Critical
Datacenters
8/28/2013
Less Work, More Flow: Revolutionizing Governance and
eDiscovery Workflow
9/4/2013 On Prem vs. Cloud Archiving
http://www.symantec.com/connect/blogs/virtual-vision-join-conversation
A Step-By-Step Disaster Recovery Blueprint 27

28. Thank you!
Copyright © 2012 Symantec Corporation. All rights reserved. Symantec and the Symantec Logo are trademarks or registered trademarks of Symantec Corporation or its affiliates in
the U.S. and other countries. Other names may be trademarks of their respective owners.

This document is provided for informational purposes only and is not intended as advertising. All warranties relating to the information in this document, either express or implied,
are disclaimed to the maximum extent allowed by law. The information in this document is subject to change without notice.

Google+ Hangout:- A Step-By-Step Disaster Recovery 28
Dave Little
NetBackup Strategist
[email protected]
Ramin Arvand
Principal Technical Architect
[email protected]