Re: [rrd-users] importing large dataset

This is a discussion on Re: [rrd-users] importing large dataset within the RRD Users forums, part of the Networking and Network Related category; --===============0267376570== Content-Type: multipart/alternative; boundary="----=_Part_620_26602073.1209219492713" ------=_Part_620_26602073.1209219492713 Content-Type: text/plain; charset=UTF-8 Content-...


Go Back   Usenet Forums > Networking and Network Related > RRD Users

FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1 (permalink)  
Old 2 Weeks Ago
Mag Gam
 
Posts: n/a
Default Re: [rrd-users] importing large dataset

--===============0267376570==
Content-Type: multipart/alternative;
boundary="----=_Part_620_26602073.1209219492713"

------=_Part_620_26602073.1209219492713
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Alex,

Thanks for getting back to me.

These are actually rates. It is a CPU utilization rate. These values are
point in time. So, at 2/3/03 11:00 CPU utilization is at 10%
Does that help for clarification?



On Sat, Apr 26, 2008 at 9:57 AM, Alex van den Bogaerdt <
alex@ergens.op.het.net> wrote:

> On Sat, Apr 26, 2008 at 09:30:03AM -0400, Mag Gam wrote:
> > I would like to import a very large dataset lets say 100MB text file.

> The
> > file consists like this.
> >
> > Date Value
> > 2/3/03 11:00 10
> > 2/3/03 11:01 12
> > 2/3/03 11:02 13
> > 2/3/03 11:03 30
> > 2/3/03 11:04 12
> > 2/3/03 11:05 13
> >
> > It keeps going on. I can generate the epoch on the left side. However, I

> am
> > unclear how to load this into rrdtool. I have followed the tutorial and

> I
> > was not able to model my data properly. Can someone please show me an
> > example for the data above?

>
> What do these numbers mean?
> When were they valid?
>
>
> RRDtool is not a graphing program. Use e.g. gnuplot for that.
>
> If these numbers are rates, you still need to know when these rates
> were valid. For instance: "12", does this mean a rate between
> "2/3/03 11:00" and "2/3/03 11:01" or between
> "2/3/03 11:01" and "2/3/03 11:02"? A small but significant difference.
> RRDtool uses end times (thus: updating for 2/3/03 11:01 is updating the
> interval upto and including 2/3/03 11:01).
>
> Are these times in some local time or in UTC? If they are in local time,
> make sure to compensate for this and don't forget about daylight saving
> (if any).
>
> You will need to convert each pair into <timestamp>:<value>, and then
> give those as input to rrdtool. This is a *very* basic operation, so
> perhaps you need to explain the problem you encounter a bit more.
>
> --
> Alex van den Bogaerdt
> http://www.vandenbogaerdt.nl/rrdtool/
>
> _______________________________________________
> rrd-users mailing list
> rrd-users@lists.oetiker.ch
> https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users
>


------=_Part_620_26602073.1209219492713
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Alex, <br><br>Thanks for getting back to me. <br><br>These are actually rates. It is a CPU utilization rate. These values are point in time. So, at 2/3/03 11:00 &nbsp;&nbsp;&nbsp;&nbsp; CPU utilization is at 10%<br>Does that help for clarification?<br>
<br><br><br><div class="gmail_quote">On Sat, Apr 26, 2008 at 9:57 AM, Alex van den Bogaerdt &lt;<a href="mailto:alex@ergens.op.het.net">alex@ergens.o p.het.net</a>&gt; wrote:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<div><div></div><div class="Wj3C7c">On Sat, Apr 26, 2008 at 09:30:03AM -0400, Mag Gam wrote:<br>
&gt; I would like to import a very large dataset lets say 100MB text file. The<br>
&gt; file consists like this.<br>
&gt;<br>
&gt; Date &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;Value<br>
&gt; 2/3/03 11:00 &nbsp; &nbsp; &nbsp; 10<br>
&gt; 2/3/03 11:01 &nbsp; &nbsp; &nbsp; 12<br>
&gt; 2/3/03 11:02 &nbsp; &nbsp; &nbsp; 13<br>
&gt; 2/3/03 11:03 &nbsp; &nbsp; &nbsp; 30<br>
&gt; 2/3/03 11:04 &nbsp; &nbsp; &nbsp; 12<br>
&gt; 2/3/03 11:05 &nbsp; &nbsp; &nbsp; 13<br>
&gt;<br>
&gt; It keeps going on. I can generate the epoch on the left side. However, I am<br>
&gt; unclear how to load this into rrdtool. I have followed the tutorial and I<br>
&gt; was not able to model my data properly. Can someone please show me an<br>
&gt; example for the data above?<br>
<br>
</div></div>What do these numbers mean?<br>
When were they valid?<br>
<br>
<br>
RRDtool is not a graphing program. Use e.g. gnuplot for that.<br>
<br>
If these numbers are rates, you still need to know when these rates<br>
were valid. &nbsp;For instance: &quot;12&quot;, does this mean a rate between<br>
&quot;2/3/03 11:00&quot; and &quot;2/3/03 11:01&quot; or between<br>
&quot;2/3/03 11:01&quot; and &quot;2/3/03 11:02&quot;? &nbsp;A small but significant difference.<br>
RRDtool uses end times (thus: updating for 2/3/03 11:01 is updating the<br>
interval upto and including 2/3/03 11:01).<br>
<br>
Are these times in some local time or in UTC? &nbsp;If they are in local time,<br>
make sure to compensate for this and don't forget about daylight saving<br>
(if any).<br>
<br>
You will need to convert each pair into &lt;timestamp&gt;:&lt;value&gt;, and then<br>
give those as input to rrdtool. &nbsp;This is a *very* basic operation, so<br>
perhaps you need to explain the problem you encounter a bit more.<br>
<font color="#888888"><br>
--<br>
Alex van den Bogaerdt<br>
<a href="http://www.vandenbogaerdt.nl/rrdtool/" target="_blank">http://www.vandenbogaerdt.nl/rrdtool/</a><br>
<br>
_______________________________________________<br >
rrd-users mailing list<br>
<a href="mailto:rrd-users@lists.oetiker.ch">rrd-users@lists.oetiker.ch</a><br>
<a href="https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users" target="_blank">https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users</a><br>
</font></blockquote></div><br>

------=_Part_620_26602073.1209219492713--


--===============0267376570==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users

--===============0267376570==--

Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are Off
[IMG] code is Off
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT +1. The time now is 06:25 PM.


Powered by vBulletin® Version 3.6.8
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO 3.0.0