RE: Open Database RSYNC
This is a discussion on RE: Open Database RSYNC within the Rsync forums, part of the Networking and Network Related category; This is a multi-part message in MIME format. --===============1451208823== Content-Type: multipart/alternative; boundary="----=_NextPart_000_004D_01C5B4A3.629AACA0" This ...
|
|||||||
| FAQ | Members List | Calendar | Search | Today's Posts | Mark Forums Read |
09-09-2005
|
|||
|
|||
RE: Open Database RSYNC
This is a multi-part message in MIME format.
--===============1451208823== Content-Type: multipart/alternative; boundary="----=_NextPart_000_004D_01C5B4A3.629AACA0" This is a multi-part message in MIME format. ------=_NextPart_000_004D_01C5B4A3.629AACA0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit MessageMuch smaller and MySQL rather than Oracle. Essentially without a "window", but done when things are supposedly relatively quiet. Two rsync's back to back. The first one takes most all of the time. The second one is fast enough that I don't bother to rebuild indexes if I pull a copy during heavy use. Guessing from limited knowledge and some experience. Large files with some new stuff at the end can take a while to find the right places to add stuff. Start the initial rsync early, very early. Expect surprises in how slow the first rsync is and how fast the second rsync is. Assuming that Oracle is any good at recovering from power failures, odds are that most everything that matters IS on disk, at least the bulk of it. (That's a guess from someone who does NOT know what he's talking about) -----Original Message----- From: rsync-bounces+tony=servacorp.com@lists.samba.org [mailto:rsync-bounces+tony=servacorp.com@lists.samba.org]On Behalf Of Poe, David Sent: Thursday, September 08, 2005 1:21 PM To: rsync@lists.samba.org Subject: Open Database RSYNC We have nearly 200 GB of data in a production Oracle database broken up into about 100 files of 2 GB. The database incurrs a 5% change per week in the form of new data, no modification nor deletions. I need to copy this data from one mount point to another then bring up the new database on the new mount point in place of the original. The high availability and production nature of this system means that my maintenance windows are few and far between. To minimize my use of the maint window, I would like to pre-copy as much data as I can with RSYNC before the window, then do a final sync of the data during the window with the database down. My question is, will RSYNC be a good option given that the Oracle database is up and running for the initial sync? I'm hoping that RSYNC will be an option for us, as other mirroring strategies I have seen rely upon same size disk devices/partitions, which we do not want because the goal is to put up a single device larger area to keep this data. Please ignore the gaping holes for ideas such as just having Oracle use another mount point in addition to the one it is already using or online VG expansions. David Poe ------=_NextPart_000_004D_01C5B4A3.629AACA0 Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"> <HTML><HEAD><TITLE>Message</TITLE> <META content=3D"text/html; charset=3Diso-8859-1" = http-equiv=3DContent-Type> <META content=3D"MSHTML 5.00.2314.1000" name=3DGENERATOR></HEAD> <BODY> <DIV><FONT color=3D#0000ff face=3DArial size=3D2><SPAN = class=3D680180723-08092005>Much=20 smaller and MySQL rather than Oracle. Essentially without a "window", = but done=20 when things are supposedly relatively quiet.</SPAN></FONT></DIV> <DIV><FONT color=3D#0000ff face=3DArial size=3D2><SPAN = class=3D680180723-08092005>Two=20 rsync's back to back. The first one takes most all of the time.=20 </SPAN></FONT></DIV> <DIV><FONT color=3D#0000ff face=3DArial size=3D2><SPAN = class=3D680180723-08092005>The=20 second one is fast enough that I don't bother to rebuild indexes if I = pull a=20 copy during heavy use.</SPAN></FONT></DIV> <DIV><FONT color=3D#0000ff face=3DArial size=3D2><SPAN=20 class=3D680180723-08092005></SPAN></FONT> </DIV> <DIV><FONT color=3D#0000ff face=3DArial size=3D2><SPAN=20 class=3D680180723-08092005>Guessing from limited knowledge and some=20 experience.</SPAN></FONT></DIV> <DIV><FONT color=3D#0000ff face=3DArial size=3D2><SPAN = class=3D680180723-08092005>Large=20 files with some new stuff at the end can take a while to find the right = places=20 to add stuff.</SPAN></FONT></DIV> <DIV><FONT color=3D#0000ff face=3DArial size=3D2><SPAN = class=3D680180723-08092005>Start=20 the initial rsync early, very early.</SPAN></FONT></DIV> <DIV><FONT color=3D#0000ff face=3DArial size=3D2><SPAN = class=3D680180723-08092005>Expect=20 surprises in how slow the first rsync is and how fast the second rsync=20 is.</SPAN></FONT></DIV> <DIV><FONT color=3D#0000ff face=3DArial size=3D2><SPAN=20 class=3D680180723-08092005></SPAN></FONT> </DIV> <DIV><FONT color=3D#0000ff face=3DArial size=3D2><SPAN=20 class=3D680180723-08092005>Assuming that Oracle is any good at = recovering from=20 power failures,</SPAN></FONT></DIV> <DIV><FONT color=3D#0000ff face=3DArial size=3D2><SPAN = class=3D680180723-08092005>odds=20 are that most everything that matters IS on disk, at least the bulk of=20 it.</SPAN></FONT></DIV> <DIV><FONT color=3D#0000ff face=3DArial size=3D2><SPAN=20 class=3D680180723-08092005>(That's a guess from someone who does NOT = know what=20 he's talking about)</SPAN></FONT></DIV> <DIV><FONT color=3D#0000ff face=3DArial size=3D2><SPAN=20 class=3D680180723-08092005></SPAN></FONT> </DIV> <DIV><FONT color=3D#0000ff face=3DArial size=3D2><SPAN=20 class=3D680180723-08092005></SPAN></FONT> </DIV> <DIV><FONT color=3D#0000ff face=3DArial size=3D2><SPAN=20 class=3D680180723-08092005></SPAN></FONT> </DIV> <DIV align=3Dleft class=3DOutlookMessageHeader dir=3Dltr><FONT = face=3DTahoma=20 size=3D2>-----Original Message-----<BR><B>From:</B>=20 rsync-bounces+tony=3Dservacorp.com@lists.samba.org=20 [mailto:rsync-bounces+tony=3Dservacorp.com@lists.samba.org]<B>On Behalf = Of=20 </B>Poe, David<BR><B>Sent:</B> Thursday, September 08, 2005 1:21=20 PM<BR><B>To:</B> rsync@lists.samba.org<BR><B>Subject:</B> Open Database=20 RSYNC<BR><BR></FONT></DIV> <DIV><SPAN class=3D230305617-08092005><FONT face=3DArial size=3D2>We = have nearly 200=20 GB of data in a production Oracle database broken up into = about 100=20 files of 2 GB. The database incurrs a 5% change per week in = the form=20 of new data, no modification nor deletions. I need to copy this = data from=20 one mount point to another then bring up the new database on the = new mount=20 point in place of the original. The high availability and = production=20 nature of this system means that my maintenance windows are few and far=20 between. To minimize my use of the maint window, I would like to = pre-copy=20 as much data as I can with RSYNC before the window, then do a final sync = of the=20 data during the window with the database down. My question is, = will RSYNC=20 be a good option given that the Oracle database is up and running for = the=20 initial sync? I'm hoping that RSYNC will be an option for us, as = other=20 mirroring strategies I have seen rely upon same size disk = devices/partitions,=20 which we do not want because the goal is to put up a single = device larger=20 area to keep this data. Please ignore the gaping holes for ideas = such as=20 just having Oracle use another mount point in addition to the one it is = already=20 using or online VG expansions.</FONT></SPAN></DIV> <DIV><FONT face=3DArial size=3D2></FONT> </DIV> <DIV align=3Dleft> <DIV align=3Dleft><FONT face=3DArial size=3D2> <DIV align=3Dleft><FONT face=3DArial=20 size=3D2>David Poe</FONT></FONT></DIV></DIV></DIV></BODY></HTML> ------=_NextPart_000_004D_01C5B4A3.629AACA0-- --===============1451208823== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html --===============1451208823==-- 
|
Linear Mode
