Re: [rrd-users] Dump and rebuild and restore XML with perl

permalink · #1 (**permalink**) 03-11-2008

--===============0300802457==
Content-Type: multipart/alternative;
boundary="----=_Part_1612_7883414.1205273000752"

------=_Part_1612_7883414.1205273000752
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

I think i have found my own problem... but not a solution (other then
starting all over with a new perl script)...

It would seem, and correct me if i'm wrong, that the rrdtool restore
requires the XML elements to be ordered. When the XML::Simple reads in and
exports to XML the order of the original XML is lost and exported in
alphebetical order. Maybe this could be considered a bug maybe it's by
design of the rrd tool. either way i'm not sure if there are any explicit
specification in XML 1.0 on element ordering.

I dont believe XML::Simple perl module can maintain the origional order of
the XML it reads in... so i'll have to find another module or another way to
rebuilding the XML file if i wasn to get around this. But just to add my
opinion, i think it would make the tool more versitail if it was not
dependend on the order of the XML.

On Mon, Mar 10, 2008 at 2:16 PM, 0xception <0xception@gmail.com> wrote:

> Hello, I'm currently working with several hundred RRD files and a large
> chunk have the incorrect step and heartbeat .they were setup with a step of
> 300 and heartbeat of 900 where i would like to change them to 600 and 1800.
> I've read that in order to accomplish this you need to dump the database
> into XML with the rrdtool dump command and then alter the XML files
> (adding/removing data points, and updating the settings) and then restore
> the database from the modified XML, please correct me if i'm wrong about
> that.
>
> Anyway I've created a Perl script to dump to XML, read in the XML and
> change the values of heartbeat and step and then remove every other data
> collection point to be inline with the step of 600 sec. I then rebuild the
> XML and save that to a file. The new XML file does not have any comments but
> contains everything else. When i try and restore the database from this XML
> file i get the error
>
> * 'ERROR: Incompatible file version, detected version . This is not
> supported by the version 0003 restore tool.*'
>
> returned. I've looked through the modified XML file and i don't see
> anything different, other then the order the tags are listed in the file.
> could this cause a problem? or could the lack of comments cause a problem?
> I'm also using the same version of rrdtool to dump as i am to restore the
> database, RRDtool 1.2.23.
>
> Original XML:
> https://www.ondashboard.com/origional.xml
>
> Modified XML:
> https://www.ondashboard.com/modified.xml
>
> Part of the Perl Script:
>
> # read XML file
> my $data = $xml->XMLin("dump.xml");
>
> $data->{step} = 600;
>
> my @xml;
>
> for my $rra ( @{ $data->{rra} } ) {
> my $lcv=0;
> my @new;
>
> # Loop through database and remove every other entry.
> for my $value ( @{ $rra->{database}->{row} } ) {
> if($lcv % 2 == 0 || $lcv == 0) {
> push(@new, \%$value);
> }
> $lcv++;
> }
>
> # Append XML with new Database
> $rra->{database}->{row} = \@new;
> push(@xml, $rra);
> }
>
> $data->{rra} = \@xml;
>
> # Export the perl structure into XML
> XMLout($data, OutputFile => $file.".xml",
> RootName => 'rrd',
> NoAttr => 1);
>
>
>
>
> Thanks.
>

------=_Part_1612_7883414.1205273000752
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

I think i have found my own problem... but not a solution (other then starting all over with a new perl script)... It would seem, and correct me if i'm wrong, that the rrdtool restore requires the XML elements to be ordered. When the XML::Simple reads in and exports to XML the order of the original XML is lost and exported in alphebetical order. Maybe this could be considered a bug maybe it's by design of the rrd tool. either way i'm not sure if there are any explicit specification in XML 1.0 on element ordering. 
 I dont believe XML::Simple perl module can maintain the origional order of the XML it reads in... so i'll have to find another module or another way to rebuilding the XML file if i wasn to get around this. But just to add my opinion, i think it would make the tool more versitail if it was not dependend on the order of the XML. 
 <div class="gmail_quote">On Mon, Mar 10, 2008 at 2:16 PM, 0xception <<a href="mailto:0xception@gmail.com">0xception@gmail. com</a>> wrote: <blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Hello, I'm currently working with several hundred RRD files and a large
chunk have the incorrect step and heartbeat .they were setup with a step of 300 and
heartbeat of 900 where i would like to change them to 600 and 1800.
I've read that in order to accomplish this you need to dump the
database into XML with the rrdtool dump command and then alter the XML
files (adding/removing data points, and updating the settings) and then
restore the database from the modified XML, please correct me if i'm
wrong about that. 
 Anyway I've created a Perl script to dump to XML, read in the XML
and change the values of heartbeat and step and then remove every other
data collection point to be inline with the step of 600 sec. I then
rebuild the XML and save that to a file. The new XML file does not have
any comments but contains everything else. When i try and restore the
database from this XML file i get the error 
    'ERROR: Incompatible file version, detected version . This is not supported by the version 0003 restore tool.' returned.
I've looked through the modified XML file and i don't see anything
different, other then the order the tags are listed in the file. could
this cause a problem? or could the lack of comments cause a problem?
I'm also using the same version of rrdtool to dump as i am to restore
the database, RRDtool 1.2.23. 
 Original XML: <a href="https://www.ondashboard.com/origional.xml" target="_blank">https://www.ondashboard.com/origional.xml</a> Modified XML: <a href="https://www.ondashboard.com/modified.xml" target="_blank">https://www.ondashboard.com/modified.xml</a> 

 Part of the Perl Script: <div style="margin-left: 40px;">    # read XML file     my $data = $xml->XMLin("dump.xml");  &nbs p;  $data->{step} = 600;         my @xml;             for my $rra ( @{ $data->{rra} } ) {                

        my $lcv=0;         my @new;       & nbsp; # Loop through database and remove every other entry.         for my $value ( @{ $rra->{database}->{row} } ) {                    if($lcv % 2 == 0 || $lcv == 0) { 

                push(@new, \%$value);                     }             $lcv++;         }          &nbs p; # Append XML with new Database         $rra->{database}->{row} = \@new;            push(@xml, $rra); 

    }         $data->{rra} = \@xml;     # Export the perl structure into XML     XMLout($data,     OutputFile => $file.".xml",             RootName => 'rrd',             NoAttr => 1); 

</div> Thanks. 
</blockquote></div> 

------=_Part_1612_7883414.1205273000752--

--===============0300802457==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

--===============0300802457==--

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode