Re: Consolidated Stats from Clusters

mohan@terabolic.com (Mohan Khurana) wrote in
news:ee9af0ff.0403281428.a9cdee0@posting.google.co m:

> Does anyone know of any possible nice methods (the easier the better),
> to get stats from apache logs when the logs are residing on a
> distributed web cluster? I am using a cluster that has 2 servers in
> it and I'd like stats on hits to both machines.
>
> The only way I could think of doing this is to write a program or
> script that copies logs from both machines into another machine on a
> regular basis, and then inserts all those log lines that had occured
> from the last run, in the right order. I could write something like
> this, however, I wondered if someone had already seen this problem
> before.
>
> Has anyone had to do something like this before and come up with a
> nice solution?
>
> Thanks much,
> mohan
>

I use cronolog to roll the log files and then awstats consolidator to
gather the logs from several virtual hosts. It should work the same for a
cluster as it does for multiple hosts on one server.

J.J.

I hear that webtrends can do this, apart from this, it's not that simple, you can try and sort them into cronological order, I think
there's something on the webalizer FAQ's section of the site


"J.J. Day" <NOSPAM.day1234@hotmail.com> wrote in message news:Xns94FCE81E9F1F1day1234hotmail@213.73.102.11. ..
> mohan@terabolic.com (Mohan Khurana) wrote in
> news:ee9af0ff.0403281428.a9cdee0@posting.google.co m:
>
> > Does anyone know of any possible nice methods (the easier the better),
> > to get stats from apache logs when the logs are residing on a
> > distributed web cluster? I am using a cluster that has 2 servers in
> > it and I'd like stats on hits to both machines.
> >
> > The only way I could think of doing this is to write a program or
> > script that copies logs from both machines into another machine on a
> > regular basis, and then inserts all those log lines that had occured
> > from the last run, in the right order. I could write something like
> > this, however, I wondered if someone had already seen this problem
> > before.
> >
> > Has anyone had to do something like this before and come up with a
> > nice solution?
> >
> > Thanks much,
> > mohan
> >
>
> I use cronolog to roll the log files and then awstats consolidator to
> gather the logs from several virtual hosts. It should work the same for a
> cluster as it does for multiple hosts on one server.
>
> J.J.

Hi,
I have tried this before and it is quite hard to get the sorting
exactly right. If you have the budget it is better to use webtrends
for it. You have to buy an additional add-on for multiple servers.
Regards,
tornell

> > > Does anyone know of any possible nice methods (the easier the better),
> > > to get stats from apache logs when the logs are residing on a
> > > distributed web cluster? I am using a cluster that has 2 servers in
> > > it and I'd like stats on hits to both machines.
> > >