Web Wiz - Green Windows Web Hosting

  New Posts New Posts RSS Feed - High Bandwidth Backup?
  FAQ FAQ  Forum Search   Events   Register Register  Login Login

High Bandwidth Backup?

 Post Reply Post Reply
Author
davidshq View Drop Down
Senior Member
Senior Member


Joined: 29 July 2003
Location: United States
Status: Offline
Points: 299
Post Options Post Options   Thanks (0) Thanks(0)   Quote davidshq Quote  Post ReplyReply Direct Link To This Post Topic: High Bandwidth Backup?
    Posted: 08 September 2005 at 4:53pm
I'm a little new to this whole Network Administrator role and I know this is mainly for web based discussions, but it seems that questions get answered even more generally...So I have the following.
How are people backing up terabytes of data without bogging down their CPU with a backup program or their network with the data?
We have Veritas 10 and were going to place Veritas 10 on one server (backup) and then hook up the tape drive to the server holding terabytes of data (bigserver). That way the processing of the backup would be handled not by bigserver, but on the other hand the data could be sent directly from bigserver to the tape driver without utilizing lots of network bandwidth.
David.
Back to Top
Gullanian View Drop Down
Senior Member
Senior Member
Avatar

Joined: 04 January 2002
Location: England
Status: Offline
Points: 4373
Post Options Post Options   Thanks (0) Thanks(0)   Quote Gullanian Quote  Post ReplyReply Direct Link To This Post Posted: 09 September 2005 at 8:21am
Is it the sort of thing you can leave running overnight when everyone in asleep?

Maybe you could allocate a certain percentage of the CPU to use in the backup?
Back to Top
davidshq View Drop Down
Senior Member
Senior Member


Joined: 29 July 2003
Location: United States
Status: Offline
Points: 299
Post Options Post Options   Thanks (0) Thanks(0)   Quote davidshq Quote  Post ReplyReply Direct Link To This Post Posted: 09 September 2005 at 9:43am
With, the data is over a terabyte now and will only continue to increase. If the machine isn't dedicated to the backup process, I have my doubts we'd ever complete a backup for the machine. Its a web server so there is very little opportunity to use CPU which is not being consumed by visitors.
David.
Back to Top
michael View Drop Down
Senior Member
Senior Member
Avatar

Joined: 08 April 2002
Location: United States
Status: Offline
Points: 4670
Post Options Post Options   Thanks (0) Thanks(0)   Quote michael Quote  Post ReplyReply Direct Link To This Post Posted: 09 September 2005 at 10:20am
Generally if you have this large a database, you would have a cluster anyway, so you can run your full backup on one server and while the servers demand is higher, users are going to be re-directed to the other one. In case of a 24/7 environment, it can become a crunch but otherwise you can run a full backup on weekends when the load is near zero and run incremental backups every day with transaction log backups every 10 minutes or so, that way it should not hold your utilization too high.
Back to Top
the boss View Drop Down
Senior Member
Senior Member
Avatar

Joined: 19 January 2003
Location: Saudi Arabia
Status: Offline
Points: 1727
Post Options Post Options   Thanks (0) Thanks(0)   Quote the boss Quote  Post ReplyReply Direct Link To This Post Posted: 10 September 2005 at 5:28pm
micheal is right.. u should be running a cluster of mirrored servers.. similar data isdistributed across servral server.. eases down the hardwork..and provides redundancy...btw.. i dont think you can be serving terabytes of data on a single web server.. which is very  busy by visitors too.. it will crash in no time..unless it has 32 Opteron CPU's and  34Gig of ramTongue..

Back to Top
dpyers View Drop Down
Senior Member
Senior Member


Joined: 12 May 2003
Status: Offline
Points: 3937
Post Options Post Options   Thanks (0) Thanks(0)   Quote dpyers Quote  Post ReplyReply Direct Link To This Post Posted: 10 September 2005 at 7:51pm
Time to think about raid striping

Lead me not into temptation... I know the short cut, follow me.
Back to Top
davidshq View Drop Down
Senior Member
Senior Member


Joined: 29 July 2003
Location: United States
Status: Offline
Points: 299
Post Options Post Options   Thanks (0) Thanks(0)   Quote davidshq Quote  Post ReplyReply Direct Link To This Post Posted: 10 September 2005 at 7:54pm
Well, we ended up creating a dedicate subnet for backup. Now the information will be transferred over a gigabit network, but a separate one from the internal network, allowing functioning to continue at full-speed (there is a lot of internal communication) but also allowing backups.
David.
Back to Top
davidshq View Drop Down
Senior Member
Senior Member


Joined: 29 July 2003
Location: United States
Status: Offline
Points: 299
Post Options Post Options   Thanks (0) Thanks(0)   Quote davidshq Quote  Post ReplyReply Direct Link To This Post Posted: 10 September 2005 at 8:02pm
We actually do use RAIDs already. But we still need backups. You can always lose two drives at the same time in a RAID 1/10 and end up in trouble.
Back to Top
 Post Reply Post Reply

Forum Jump Forum Permissions View Drop Down

Forum Software by Web Wiz Forums® version 12.08
Copyright ©2001-2026 Web Wiz Ltd.


Become a Fan on Facebook Follow us on X Connect with us on LinkedIn Web Wiz Blogs
About Web Wiz | Contact Web Wiz | Terms & Conditions | Cookies | Privacy Notice

Web Wiz is the trading name of Web Wiz Ltd. Company registration No. 05977755. Registered in England and Wales.
Registered office: Web Wiz Ltd, Unit 18, The Glenmore Centre, Fancy Road, Poole, Dorset, BH12 4FB, UK.

Prices exclude VAT at 20% unless otherwise stated. VAT No. GB988999105 - $, € prices shown as a guideline only.

Copyright ©2001-2026 Web Wiz Ltd. All rights reserved.