Elapsed Time too high

Hi All,

I am trying to find a solution from past three days but all in vain.
Any help would be great.

I am running a qmail server from past year or so , It was running fine.

Conncurrencyincoming 100
Remote - 100
Local 100

And it was hardly using 10 - 20 connections. All of a sudden friday
night all connections on concurrencyincoming came 100 and the frequency
of the email coming is same. The delivery is slow. After playing here
and there when I killall qmail-smtpd it gives me error in
qmail-queue.log in /var/spool/qmailscan which is below:

g_e_h: no sender and no recips, from via SMTP from x.x.x.x Dropping.

I get many of these and qmail-smtpd restarts from 1 but fills up very
fast.

Clamd is running and SA is also running fine.

Where can be the problem as there was nothing which was installed ot
touched in the config ?

Thanks
Hemant

techxprt wrote:

> Hi All,
>
> I am trying to find a solution from past three days but all in vain.
> Any help would be great.
>
> I am running a qmail server from past year or so , It was running fine.
>
> Conncurrencyincoming 100
> Remote - 100
> Local 100
>
> And it was hardly using 10 - 20 connections. All of a sudden friday
> night all connections on concurrencyincoming came 100 and the frequency
> of the email coming is same. The delivery is slow. After playing here
> and there when I killall qmail-smtpd it gives me error in
> qmail-queue.log in /var/spool/qmailscan which is below:
>
> g_e_h: no sender and no recips, from via SMTP from x.x.x.x Dropping.
>
> I get many of these and qmail-smtpd restarts from 1 but fills up very
> fast.
>
> Clamd is running and SA is also running fine.
>
> Where can be the problem as there was nothing which was installed ot
> touched in the config ?
>
> Thanks
> Hemant
>

Hemant,

There is not enough information here to make a concrete determination of
the issue.

What are the sources of the connections?

What patches have you applied to qmail?

As Dave Sill would say, "What does qmail-showctl say? What do the logs
say?":)

In the logs above it refefences the qmail-smtpd logs not qmail-scanner's.

Try the following from a different local system:
telnet your_server 25
helo systems_name
(wait for a 2xx message, if something else you have a problem)
mail from: <your_full_email_address>
(wait for a 2xx message, if something else you have a problem)
rcpt to: <recipients_full_email_address)
(wait for a 2xx message, if something else you have a problem)
data
(wait for a 3xx message, if something else you have a problem)
From: <your_email_address>
To: <recipients_full_email_address>
Subject: Test_subject

this
is
just
a
test
..
(wait for a 2xx message, if something else you have a problem)
rset
(wait for a 2xx message, if something else you have a problem)
quit
(wait for a 2xx message, if something else is received, it might be
insignificant)

How is qmail-smtpd started? If the qmail installation followed
www.lifewithqmail.org, is the log for qmail-smtpd being updated?
Provide the run for both the qmail-smtpd and for the log.

AK

Thanks AK for reply,

Below are the details

Qmail-Smtpd Logs show

@40000000432ccb9c12c273bc tcpserver: pid 1892 from x.x.x.x
@40000000432ccb9c12d4ee34 tcpserver: ok 1892 mailservername:x.x.x.x:25
sendersmailserver:x.x.x.x::45465
@40000000432ccb9c12e067b4 tcpserver: end 1892 status 0
@40000000432ccb9c12e0736c tcpserver: status: 119/450
@40000000432ccb9c3b3c5844 tcpserver: status: 120/450
@40000000432ccb9c3b3d5dfc tcpserver: pid 1894 from x.x.x.x
@40000000432ccb9d0c10861c tcpserver: ok 1894 mailservername:x.x.x.x:25
sendersmailserver:x.x.x.x:21413
@40000000432ccb9d145c8064 tcpserver: status: 121/450
@40000000432ccb9d145e0aec tcpserver: pid 1896 from x.x.x.x
@40000000432ccb9d14720fec tcpserver: ok 1896 mailservername:x.x.x.x:25
sendersmailserver:x.x.x.x::45468
@40000000432ccb9d147cb294 tcpserver: end 1896 status 0
@40000000432ccb9d147d143c tcpserver: status: 120/450
@40000000432ccb9e16189fb4 tcpserver: status: 121/450
@40000000432ccb9e1619dc1c tcpserver: pid 1908 from x.x.x.x
@40000000432ccb9e162e98b4 tcpserver: ok 1908 mailservername:x.x.x.x:25
sendersmailserver:x.x.x.x::45473
@40000000432ccb9e1639c7fc tcpserver: end 1908 status 0
@40000000432ccb9e163a1dec tcpserver: status: 120/450
@40000000432ccb9f17ea1bc4 tcpserver: status: 121/450
@40000000432ccb9f17ebcd5c tcpserver: pid 1909 from x.x.x.x
@40000000432ccb9f17fd1724 tcpserver: ok 1909 mailservername:x.x.x.x:25
sendersmailserver:x.x.x.x::45477
@40000000432ccb9f18083e9c tcpserver: end 1909 status 0
@40000000432ccb9f180890a4 tcpserver: status: 120/450

I tried sending the email the way you said. All works fine. The emails
are delvd but somehow the connections keep on increasing and the smtpd
start giving error to people.

This is qmail-smtpd run

QMAILQUEUE="/var/qmail/bin/qmail-scanner-queue" export QMAILQUEUE
QMAILDUID=`id -u qmaild`
NOFILESGID=`id -g qmaild`
MAXSMTPD=`cat /var/qmail/control/concurrencyincoming`
LOCAL=`head -1 /var/qmail/control/me`

if [ -z "$QMAILDUID" -o -z "$NOFILESGID" -o -z "$MAXSMTPD" -o -z
"$LOCAL" ]; then
echo QMAILDUID, NOFILESGID, MAXSMTPD, or LOCAL is unset in
echo /var/qmail/supervise/qmail-smtpd/run
exit 1
fi

if [ ! -f /var/qmail/control/rcpthosts ]; then
echo "No /var/qmail/control/rcpthosts!"
echo "Refusing to start SMTP listener because it'll create an open
relay"
exit 1
fi

exec /usr/local/bin/softlimit -m 80000000 \
/usr/local/bin/tcpserver -v -R -l "$LOCAL" -x /etc/tcp.smtp.cdb -c
"$MAXSMTPD" \
-u "$QMAILDUID" -g "$NOFILESGID" 0 smtp
/var/qmail/bin/qmail-smtpd 2>&1


Earlier the softlimit was 40 , I just increased it to 80 but doesnt
make any difference. The qmail was installed by soomebody else and it
was working for years and all of sudden on friday it starts increasing
the smtpd connection and giving problem.

It delivers the emails fine but the emails which are not delivered they
give no sender , no recips error in qmail-queue.log.

And qmail-smtpd log run file

exec /usr/local/bin/setuidgid qmaill /usr/local/bin/multilog t
s10000000 n20 /var/log/qmail/smtpd

Just for reference in my process list there are lot of qmail-scanner.pl

qmaild 4212 0.0 0.0 1396 420 ? S 12:13 0:00
/var/qmail/bin/qmail-smtpd
qmaild 4219 0.0 0.0 1396 420 ? S 12:13 0:00
/var/qmail/bin/qmail-smtpd
qscand 4223 0.1 0.4 6312 4488 ? S 12:13 0:00
/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
qscand 4224 0.1 0.4 6312 4488 ? S 12:13 0:00
/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
qmaild 4233 0.0 0.0 1392 416 ? S 12:13 0:00
/var/qmail/bin/qmail-smtpd
qmaild 4235 0.0 0.0 1396 420 ? S 12:13 0:00
/var/qmail/bin/qmail-smtpd
qscand 4248 0.1 0.4 6312 4488 ? S 12:13 0:00
/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
qscand 4252 0.1 0.4 6312 4488 ? S 12:13 0:00
/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
qmaild 4288 0.0 0.0 1400 424 ? S 12:13 0:00
/var/qmail/bin/qmail-smtpd
qscand 4290 0.1 0.4 6312 4488 ? S 12:13 0:00
/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
qmaild 4314 0.0 0.0 1400 424 ? S 12:13 0:00
/var/qmail/bin/qmail-smtpd
qscand 4315 0.1 0.4 6312 4488 ? S 12:13 0:00
/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
qmaild 4316 0.0 0.0 1396 420 ? S 12:13 0:00
/var/qmail/bin/qmail-smtpd
qscand 4324 0.1 0.4 6312 4488 ? S 12:13 0:00
/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
qmaild 4344 0.0 0.0 1400 424 ? S 12:14 0:00
/var/qmail/bin/qmail-smtpd
qscand 4347 0.1 0.4 6312 4488 ? S 12:14 0:00
/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
vpopmail 4370 0.0 0.0 1400 500 ? S 12:14 0:00
/usr/local/courier-imap/bin/pop3d Maildir
vpopmail 4371 0.0 0.0 1396 496 ? S 12:14 0:00
/usr/local/courier-imap/bin/pop3d Maildir
qmaild 4373 0.0 0.0 1396 420 ? S 12:14 0:00
/var/qmail/bin/qmail-smtpd
qscand 4374 0.1 0.4 6312 4488 ? S 12:14 0:00
/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
qmaild 4394 0.0 0.0 1396 420 ? S 12:14 0:00
/var/qmail/bin/qmail-smtpd
qscand 4397 0.2 0.4 6312 4488 ? S 12:14 0:00
/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
vpopmail 4401 0.0 0.0 1396 428 ? S 12:14 0:00
/usr/local/courier-imap/bin/pop3d Maildir
qmaild 4403 0.0 0.0 1400 424 ? S 12:14 0:00
/var/qmail/bin/qmail-smtpd
qscand 4406 0.2 0.4 6312 4488 ? S 12:14 0:00
/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl

Please suggest something to resolve this problem. Its getting crazy
with this

Thanks
Hemant

techxprt wrote:
> Thanks AK for reply,
>
> Below are the details
>
> Qmail-Smtpd Logs show
>
> @40000000432ccb9c12c273bc tcpserver: pid 1892 from x.x.x.x
> @40000000432ccb9c12d4ee34 tcpserver: ok 1892 mailservername:x.x.x.x:25
> sendersmailserver:x.x.x.x::45465
> @40000000432ccb9c12e067b4 tcpserver: end 1892 status 0
> @40000000432ccb9c12e0736c tcpserver: status: 119/450
> @40000000432ccb9c3b3c5844 tcpserver: status: 120/450
> @40000000432ccb9c3b3d5dfc tcpserver: pid 1894 from x.x.x.x
> @40000000432ccb9d0c10861c tcpserver: ok 1894 mailservername:x.x.x.x:25
> sendersmailserver:x.x.x.x:21413
> @40000000432ccb9d145c8064 tcpserver: status: 121/450
> @40000000432ccb9d145e0aec tcpserver: pid 1896 from x.x.x.x
> @40000000432ccb9d14720fec tcpserver: ok 1896 mailservername:x.x.x.x:25
> sendersmailserver:x.x.x.x::45468
> @40000000432ccb9d147cb294 tcpserver: end 1896 status 0
> @40000000432ccb9d147d143c tcpserver: status: 120/450
> @40000000432ccb9e16189fb4 tcpserver: status: 121/450
> @40000000432ccb9e1619dc1c tcpserver: pid 1908 from x.x.x.x
> @40000000432ccb9e162e98b4 tcpserver: ok 1908 mailservername:x.x.x.x:25
> sendersmailserver:x.x.x.x::45473
> @40000000432ccb9e1639c7fc tcpserver: end 1908 status 0
> @40000000432ccb9e163a1dec tcpserver: status: 120/450
> @40000000432ccb9f17ea1bc4 tcpserver: status: 121/450
> @40000000432ccb9f17ebcd5c tcpserver: pid 1909 from x.x.x.x
> @40000000432ccb9f17fd1724 tcpserver: ok 1909 mailservername:x.x.x.x:25
> sendersmailserver:x.x.x.x::45477
> @40000000432ccb9f18083e9c tcpserver: end 1909 status 0
> @40000000432ccb9f180890a4 tcpserver: status: 120/450
>
> I tried sending the email the way you said. All works fine. The emails
> are delvd but somehow the connections keep on increasing and the smtpd
> start giving error to people.
>
> This is qmail-smtpd run
>
> QMAILQUEUE="/var/qmail/bin/qmail-scanner-queue" export QMAILQUEUE
> QMAILDUID=`id -u qmaild`
> NOFILESGID=`id -g qmaild`
> MAXSMTPD=`cat /var/qmail/control/concurrencyincoming`
> LOCAL=`head -1 /var/qmail/control/me`
>
> if [ -z "$QMAILDUID" -o -z "$NOFILESGID" -o -z "$MAXSMTPD" -o -z
> "$LOCAL" ]; then
> echo QMAILDUID, NOFILESGID, MAXSMTPD, or LOCAL is unset in
> echo /var/qmail/supervise/qmail-smtpd/run
> exit 1
> fi
>
> if [ ! -f /var/qmail/control/rcpthosts ]; then
> echo "No /var/qmail/control/rcpthosts!"
> echo "Refusing to start SMTP listener because it'll create an open
> relay"
> exit 1
> fi
>
> exec /usr/local/bin/softlimit -m 80000000 \
> /usr/local/bin/tcpserver -v -R -l "$LOCAL" -x /etc/tcp.smtp.cdb -c
> "$MAXSMTPD" \
> -u "$QMAILDUID" -g "$NOFILESGID" 0 smtp
> /var/qmail/bin/qmail-smtpd 2>&1
>
>
> Earlier the softlimit was 40 , I just increased it to 80 but doesnt
> make any difference. The qmail was installed by soomebody else and it
> was working for years and all of sudden on friday it starts increasing
> the smtpd connection and giving problem.
>
> It delivers the emails fine but the emails which are not delivered they
> give no sender , no recips error in qmail-queue.log.
>
> And qmail-smtpd log run file
>
> exec /usr/local/bin/setuidgid qmaill /usr/local/bin/multilog t
> s10000000 n20 /var/log/qmail/smtpd
>
> Just for reference in my process list there are lot of qmail-scanner.pl
>
> qmaild 4212 0.0 0.0 1396 420 ? S 12:13 0:00
> /var/qmail/bin/qmail-smtpd
> qmaild 4219 0.0 0.0 1396 420 ? S 12:13 0:00
> /var/qmail/bin/qmail-smtpd
> qscand 4223 0.1 0.4 6312 4488 ? S 12:13 0:00
> /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> qscand 4224 0.1 0.4 6312 4488 ? S 12:13 0:00
> /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> qmaild 4233 0.0 0.0 1392 416 ? S 12:13 0:00
> /var/qmail/bin/qmail-smtpd
> qmaild 4235 0.0 0.0 1396 420 ? S 12:13 0:00
> /var/qmail/bin/qmail-smtpd
> qscand 4248 0.1 0.4 6312 4488 ? S 12:13 0:00
> /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> qscand 4252 0.1 0.4 6312 4488 ? S 12:13 0:00
> /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> qmaild 4288 0.0 0.0 1400 424 ? S 12:13 0:00
> /var/qmail/bin/qmail-smtpd
> qscand 4290 0.1 0.4 6312 4488 ? S 12:13 0:00
> /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> qmaild 4314 0.0 0.0 1400 424 ? S 12:13 0:00
> /var/qmail/bin/qmail-smtpd
> qscand 4315 0.1 0.4 6312 4488 ? S 12:13 0:00
> /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> qmaild 4316 0.0 0.0 1396 420 ? S 12:13 0:00
> /var/qmail/bin/qmail-smtpd
> qscand 4324 0.1 0.4 6312 4488 ? S 12:13 0:00
> /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> qmaild 4344 0.0 0.0 1400 424 ? S 12:14 0:00
> /var/qmail/bin/qmail-smtpd
> qscand 4347 0.1 0.4 6312 4488 ? S 12:14 0:00
> /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> vpopmail 4370 0.0 0.0 1400 500 ? S 12:14 0:00
> /usr/local/courier-imap/bin/pop3d Maildir
> vpopmail 4371 0.0 0.0 1396 496 ? S 12:14 0:00
> /usr/local/courier-imap/bin/pop3d Maildir
> qmaild 4373 0.0 0.0 1396 420 ? S 12:14 0:00
> /var/qmail/bin/qmail-smtpd
> qscand 4374 0.1 0.4 6312 4488 ? S 12:14 0:00
> /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> qmaild 4394 0.0 0.0 1396 420 ? S 12:14 0:00
> /var/qmail/bin/qmail-smtpd
> qscand 4397 0.2 0.4 6312 4488 ? S 12:14 0:00
> /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> vpopmail 4401 0.0 0.0 1396 428 ? S 12:14 0:00
> /usr/local/courier-imap/bin/pop3d Maildir
> qmaild 4403 0.0 0.0 1400 424 ? S 12:14 0:00
> /var/qmail/bin/qmail-smtpd
> qscand 4406 0.2 0.4 6312 4488 ? S 12:14 0:00
> /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
>
> Please suggest something to resolve this problem. Its getting crazy
> with this
>
> Thanks
> Hemant
>

How much resources are available on the system? You are accepting upto
450 simulteneous connections.

Are you being spammed or virus mailings?

Using the qmail-smtpd log, see if a pattern develops for the sending
mail servers.

Try using -D -H in the qmail-smtpd's run file.
Will not be a delay of two seconds (-D)
Will not attempt to lookup the hostname (-H)

The log you provide has no useful information.

You need to see whether a pattern develops. Consult the qmail-send logs.

Is your qmail-queue-scanner running in debug mode? Look through it and
see what that tells you.

Likely issue is that the amount of mailing you began receiving is
exceeding the amount of mail your server/s can handle.

AK

Thanks AK for reply,

I tried changing those parameters.

The mainly traffic is from hotmail and ebay. Not to forget the email
server is serving around 3000 email ids.

I am getting these entries in qmail-queue.log

Sun, 18 Sep 2005 21:33:59 EST:20014: unsetting QMAILQUEUE env var
Sun, 18 Sep 2005 21:33:59 EST:20014: g_e_h: no sender and no recips.
Sun, 18 Sep 2005 21:33:59 EST:20014: cleanup: /usr/bin/rm -rf
/var/spool/qmailscan/tmp/mail1112704323964720014/
/var/spool/qmailscan/working/new/mail1112704323964720014

And the messages finishes in aboout 145 seconds or sometimes 300
seconds.

Is there any way I can check the message header of message delayed or
takes so much time.

And the other thing I found in qmail-queue.log is that the messages got
dumped in the directory and picked afte a long time

Sun, 18 Sep 2005 21:42:11 EST:22812: +++ starting debugging for process
22812 by uid=1003
Sun, 18 Sep 2005 21:42:11 EST:22812: setting UID to EUID so
subprocesses can access files generated by this script
Sun, 18 Sep 2005 21:42:11 EST:22812: program name is
qmail-scanner-queue.pl, version 1.22st
Sun, 18 Sep 2005 21:42:11 EST:22812: incoming SMTP connection from via
SMTP from 66.135.197.7
Sun, 18 Sep 2005 21:42:11 EST:22812: w_c: mkdir
/var/spool/qmailscan/tmp/mail1112704373164722812
Sun, 18 Sep 2005 21:42:11 EST:22812: w_c: start dumping incoming msg
into /var/spool/qmailscan/working/tmp/mail1112704373164722812
[1127043731.67888]
Sun, 18 Sep 2005 21:42:11 EST:22809: w_c: attachment 2: Content-Type
of text/plain found

and if I see this file
/var/spool/qmailscan/working/tmp/mail1112704373164722812 its empty and
there are lot many files which are empty and all are I think the
connections which are not solved or delayed.

Please suggest.

Thanks
Hemant




AK wrote:
> techxprt wrote:
> > Thanks AK for reply,
> >
> > Below are the details
> >
> > Qmail-Smtpd Logs show
> >
> > @40000000432ccb9c12c273bc tcpserver: pid 1892 from x.x.x.x
> > @40000000432ccb9c12d4ee34 tcpserver: ok 1892 mailservername:x.x.x.x:25
> > sendersmailserver:x.x.x.x::45465
> > @40000000432ccb9c12e067b4 tcpserver: end 1892 status 0
> > @40000000432ccb9c12e0736c tcpserver: status: 119/450
> > @40000000432ccb9c3b3c5844 tcpserver: status: 120/450
> > @40000000432ccb9c3b3d5dfc tcpserver: pid 1894 from x.x.x.x
> > @40000000432ccb9d0c10861c tcpserver: ok 1894 mailservername:x.x.x.x:25
> > sendersmailserver:x.x.x.x:21413
> > @40000000432ccb9d145c8064 tcpserver: status: 121/450
> > @40000000432ccb9d145e0aec tcpserver: pid 1896 from x.x.x.x
> > @40000000432ccb9d14720fec tcpserver: ok 1896 mailservername:x.x.x.x:25
> > sendersmailserver:x.x.x.x::45468
> > @40000000432ccb9d147cb294 tcpserver: end 1896 status 0
> > @40000000432ccb9d147d143c tcpserver: status: 120/450
> > @40000000432ccb9e16189fb4 tcpserver: status: 121/450
> > @40000000432ccb9e1619dc1c tcpserver: pid 1908 from x.x.x.x
> > @40000000432ccb9e162e98b4 tcpserver: ok 1908 mailservername:x.x.x.x:25
> > sendersmailserver:x.x.x.x::45473
> > @40000000432ccb9e1639c7fc tcpserver: end 1908 status 0
> > @40000000432ccb9e163a1dec tcpserver: status: 120/450
> > @40000000432ccb9f17ea1bc4 tcpserver: status: 121/450
> > @40000000432ccb9f17ebcd5c tcpserver: pid 1909 from x.x.x.x
> > @40000000432ccb9f17fd1724 tcpserver: ok 1909 mailservername:x.x.x.x:25
> > sendersmailserver:x.x.x.x::45477
> > @40000000432ccb9f18083e9c tcpserver: end 1909 status 0
> > @40000000432ccb9f180890a4 tcpserver: status: 120/450
> >
> > I tried sending the email the way you said. All works fine. The emails
> > are delvd but somehow the connections keep on increasing and the smtpd
> > start giving error to people.
> >
> > This is qmail-smtpd run
> >
> > QMAILQUEUE="/var/qmail/bin/qmail-scanner-queue" export QMAILQUEUE
> > QMAILDUID=`id -u qmaild`
> > NOFILESGID=`id -g qmaild`
> > MAXSMTPD=`cat /var/qmail/control/concurrencyincoming`
> > LOCAL=`head -1 /var/qmail/control/me`
> >
> > if [ -z "$QMAILDUID" -o -z "$NOFILESGID" -o -z "$MAXSMTPD" -o -z
> > "$LOCAL" ]; then
> > echo QMAILDUID, NOFILESGID, MAXSMTPD, or LOCAL is unset in
> > echo /var/qmail/supervise/qmail-smtpd/run
> > exit 1
> > fi
> >
> > if [ ! -f /var/qmail/control/rcpthosts ]; then
> > echo "No /var/qmail/control/rcpthosts!"
> > echo "Refusing to start SMTP listener because it'll create an open
> > relay"
> > exit 1
> > fi
> >
> > exec /usr/local/bin/softlimit -m 80000000 \
> > /usr/local/bin/tcpserver -v -R -l "$LOCAL" -x /etc/tcp.smtp.cdb -c
> > "$MAXSMTPD" \
> > -u "$QMAILDUID" -g "$NOFILESGID" 0 smtp
> > /var/qmail/bin/qmail-smtpd 2>&1
> >
> >
> > Earlier the softlimit was 40 , I just increased it to 80 but doesnt
> > make any difference. The qmail was installed by soomebody else and it
> > was working for years and all of sudden on friday it starts increasing
> > the smtpd connection and giving problem.
> >
> > It delivers the emails fine but the emails which are not delivered they
> > give no sender , no recips error in qmail-queue.log.
> >
> > And qmail-smtpd log run file
> >
> > exec /usr/local/bin/setuidgid qmaill /usr/local/bin/multilog t
> > s10000000 n20 /var/log/qmail/smtpd
> >
> > Just for reference in my process list there are lot of qmail-scanner.pl
> >
> > qmaild 4212 0.0 0.0 1396 420 ? S 12:13 0:00
> > /var/qmail/bin/qmail-smtpd
> > qmaild 4219 0.0 0.0 1396 420 ? S 12:13 0:00
> > /var/qmail/bin/qmail-smtpd
> > qscand 4223 0.1 0.4 6312 4488 ? S 12:13 0:00
> > /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> > qscand 4224 0.1 0.4 6312 4488 ? S 12:13 0:00
> > /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> > qmaild 4233 0.0 0.0 1392 416 ? S 12:13 0:00
> > /var/qmail/bin/qmail-smtpd
> > qmaild 4235 0.0 0.0 1396 420 ? S 12:13 0:00
> > /var/qmail/bin/qmail-smtpd
> > qscand 4248 0.1 0.4 6312 4488 ? S 12:13 0:00
> > /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> > qscand 4252 0.1 0.4 6312 4488 ? S 12:13 0:00
> > /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> > qmaild 4288 0.0 0.0 1400 424 ? S 12:13 0:00
> > /var/qmail/bin/qmail-smtpd
> > qscand 4290 0.1 0.4 6312 4488 ? S 12:13 0:00
> > /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> > qmaild 4314 0.0 0.0 1400 424 ? S 12:13 0:00
> > /var/qmail/bin/qmail-smtpd
> > qscand 4315 0.1 0.4 6312 4488 ? S 12:13 0:00
> > /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> > qmaild 4316 0.0 0.0 1396 420 ? S 12:13 0:00
> > /var/qmail/bin/qmail-smtpd
> > qscand 4324 0.1 0.4 6312 4488 ? S 12:13 0:00
> > /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> > qmaild 4344 0.0 0.0 1400 424 ? S 12:14 0:00
> > /var/qmail/bin/qmail-smtpd
> > qscand 4347 0.1 0.4 6312 4488 ? S 12:14 0:00
> > /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> > vpopmail 4370 0.0 0.0 1400 500 ? S 12:14 0:00
> > /usr/local/courier-imap/bin/pop3d Maildir
> > vpopmail 4371 0.0 0.0 1396 496 ? S 12:14 0:00
> > /usr/local/courier-imap/bin/pop3d Maildir
> > qmaild 4373 0.0 0.0 1396 420 ? S 12:14 0:00
> > /var/qmail/bin/qmail-smtpd
> > qscand 4374 0.1 0.4 6312 4488 ? S 12:14 0:00
> > /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> > qmaild 4394 0.0 0.0 1396 420 ? S 12:14 0:00
> > /var/qmail/bin/qmail-smtpd
> > qscand 4397 0.2 0.4 6312 4488 ? S 12:14 0:00
> > /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> > vpopmail 4401 0.0 0.0 1396 428 ? S 12:14 0:00
> > /usr/local/courier-imap/bin/pop3d Maildir
> > qmaild 4403 0.0 0.0 1400 424 ? S 12:14 0:00
> > /var/qmail/bin/qmail-smtpd
> > qscand 4406 0.2 0.4 6312 4488 ? S 12:14 0:00
> > /usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
> >
> > Please suggest something to resolve this problem. Its getting crazy
> > with this
> >
> > Thanks
> > Hemant
> >
>
> How much resources are available on the system? You are accepting upto
> 450 simulteneous connections.
>
> Are you being spammed or virus mailings?
>
> Using the qmail-smtpd log, see if a pattern develops for the sending
> mail servers.
>
> Try using -D -H in the qmail-smtpd's run file.
> Will not be a delay of two seconds (-D)
> Will not attempt to lookup the hostname (-H)
>
> The log you provide has no useful information.
>
> You need to see whether a pattern develops. Consult the qmail-send logs.
>
> Is your qmail-queue-scanner running in debug mode? Look through it and
> see what that tells you.
>
> Likely issue is that the amount of mailing you began receiving is
> exceeding the amount of mail your server/s can handle.
>
> AK

techxprt wrote:
> Thanks AK for reply,
>
> I tried changing those parameters.
>
> The mainly traffic is from hotmail and ebay. Not to forget the email
> server is serving around 3000 email ids.
>
> I am getting these entries in qmail-queue.log
>
> Sun, 18 Sep 2005 21:33:59 EST:20014: unsetting QMAILQUEUE env var
> Sun, 18 Sep 2005 21:33:59 EST:20014: g_e_h: no sender and no recips.
> Sun, 18 Sep 2005 21:33:59 EST:20014: cleanup: /usr/bin/rm -rf
> /var/spool/qmailscan/tmp/mail1112704323964720014/
> /var/spool/qmailscan/working/new/mail1112704323964720014
>
> And the messages finishes in aboout 145 seconds or sometimes 300
> seconds.
>
> Is there any way I can check the message header of message delayed or
> takes so much time.
>
> And the other thing I found in qmail-queue.log is that the messages got
> dumped in the directory and picked afte a long time
>
> Sun, 18 Sep 2005 21:42:11 EST:22812: +++ starting debugging for process
> 22812 by uid=1003
> Sun, 18 Sep 2005 21:42:11 EST:22812: setting UID to EUID so
> subprocesses can access files generated by this script
> Sun, 18 Sep 2005 21:42:11 EST:22812: program name is
> qmail-scanner-queue.pl, version 1.22st
> Sun, 18 Sep 2005 21:42:11 EST:22812: incoming SMTP connection from via
> SMTP from 66.135.197.7
> Sun, 18 Sep 2005 21:42:11 EST:22812: w_c: mkdir
> /var/spool/qmailscan/tmp/mail1112704373164722812
> Sun, 18 Sep 2005 21:42:11 EST:22812: w_c: start dumping incoming msg
> into /var/spool/qmailscan/working/tmp/mail1112704373164722812
> [1127043731.67888]
> Sun, 18 Sep 2005 21:42:11 EST:22809: w_c: attachment 2: Content-Type
> of text/plain found
>
> and if I see this file
> /var/spool/qmailscan/working/tmp/mail1112704373164722812 its empty and
> there are lot many files which are empty and all are I think the
> connections which are not solved or delayed.
>
> Please suggest.
>
> Thanks
> Hemant
>
>
>
>
> AK wrote:
>
>>techxprt wrote:
>>
>>>Thanks AK for reply,
>>>
>>>Below are the details
>>>
>>>Qmail-Smtpd Logs show
>>>
>>>@40000000432ccb9c12c273bc tcpserver: pid 1892 from x.x.x.x
>>>@40000000432ccb9c12d4ee34 tcpserver: ok 1892 mailservername:x.x.x.x:25
>>>sendersmailserver:x.x.x.x::45465
>>>@40000000432ccb9c12e067b4 tcpserver: end 1892 status 0
>>>@40000000432ccb9c12e0736c tcpserver: status: 119/450
>>>@40000000432ccb9c3b3c5844 tcpserver: status: 120/450
>>>@40000000432ccb9c3b3d5dfc tcpserver: pid 1894 from x.x.x.x
>>>@40000000432ccb9d0c10861c tcpserver: ok 1894 mailservername:x.x.x.x:25
>>>sendersmailserver:x.x.x.x:21413
>>>@40000000432ccb9d145c8064 tcpserver: status: 121/450
>>>@40000000432ccb9d145e0aec tcpserver: pid 1896 from x.x.x.x
>>>@40000000432ccb9d14720fec tcpserver: ok 1896 mailservername:x.x.x.x:25
>>>sendersmailserver:x.x.x.x::45468
>>>@40000000432ccb9d147cb294 tcpserver: end 1896 status 0
>>>@40000000432ccb9d147d143c tcpserver: status: 120/450
>>>@40000000432ccb9e16189fb4 tcpserver: status: 121/450
>>>@40000000432ccb9e1619dc1c tcpserver: pid 1908 from x.x.x.x
>>>@40000000432ccb9e162e98b4 tcpserver: ok 1908 mailservername:x.x.x.x:25
>>>sendersmailserver:x.x.x.x::45473
>>>@40000000432ccb9e1639c7fc tcpserver: end 1908 status 0
>>>@40000000432ccb9e163a1dec tcpserver: status: 120/450
>>>@40000000432ccb9f17ea1bc4 tcpserver: status: 121/450
>>>@40000000432ccb9f17ebcd5c tcpserver: pid 1909 from x.x.x.x
>>>@40000000432ccb9f17fd1724 tcpserver: ok 1909 mailservername:x.x.x.x:25
>>>sendersmailserver:x.x.x.x::45477
>>>@40000000432ccb9f18083e9c tcpserver: end 1909 status 0
>>>@40000000432ccb9f180890a4 tcpserver: status: 120/450
>>>
>>>I tried sending the email the way you said. All works fine. The emails
>>>are delvd but somehow the connections keep on increasing and the smtpd
>>>start giving error to people.
>>>
>>>This is qmail-smtpd run
>>>
>>>QMAILQUEUE="/var/qmail/bin/qmail-scanner-queue" export QMAILQUEUE
>>>QMAILDUID=`id -u qmaild`
>>>NOFILESGID=`id -g qmaild`
>>>MAXSMTPD=`cat /var/qmail/control/concurrencyincoming`
>>>LOCAL=`head -1 /var/qmail/control/me`
>>>
>>>if [ -z "$QMAILDUID" -o -z "$NOFILESGID" -o -z "$MAXSMTPD" -o -z
>>>"$LOCAL" ]; then
>>> echo QMAILDUID, NOFILESGID, MAXSMTPD, or LOCAL is unset in
>>> echo /var/qmail/supervise/qmail-smtpd/run
>>> exit 1
>>>fi
>>>
>>>if [ ! -f /var/qmail/control/rcpthosts ]; then
>>> echo "No /var/qmail/control/rcpthosts!"
>>> echo "Refusing to start SMTP listener because it'll create an open
>>>relay"
>>> exit 1
>>>fi
>>>
>>>exec /usr/local/bin/softlimit -m 80000000 \
>>> /usr/local/bin/tcpserver -v -R -l "$LOCAL" -x /etc/tcp.smtp.cdb -c
>>>"$MAXSMTPD" \
>>> -u "$QMAILDUID" -g "$NOFILESGID" 0 smtp
>>>/var/qmail/bin/qmail-smtpd 2>&1
>>>
>>>
>>>Earlier the softlimit was 40 , I just increased it to 80 but doesnt
>>>make any difference. The qmail was installed by soomebody else and it
>>>was working for years and all of sudden on friday it starts increasing
>>>the smtpd connection and giving problem.
>>>
>>>It delivers the emails fine but the emails which are not delivered they
>>>give no sender , no recips error in qmail-queue.log.
>>>
>>>And qmail-smtpd log run file
>>>
>>>exec /usr/local/bin/setuidgid qmaill /usr/local/bin/multilog t
>>>s10000000 n20 /var/log/qmail/smtpd
>>>
>>>Just for reference in my process list there are lot of qmail-scanner.pl
>>>
>>>qmaild 4212 0.0 0.0 1396 420 ? S 12:13 0:00
>>>/var/qmail/bin/qmail-smtpd
>>>qmaild 4219 0.0 0.0 1396 420 ? S 12:13 0:00
>>>/var/qmail/bin/qmail-smtpd
>>>qscand 4223 0.1 0.4 6312 4488 ? S 12:13 0:00
>>>/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
>>>qscand 4224 0.1 0.4 6312 4488 ? S 12:13 0:00
>>>/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
>>>qmaild 4233 0.0 0.0 1392 416 ? S 12:13 0:00
>>>/var/qmail/bin/qmail-smtpd
>>>qmaild 4235 0.0 0.0 1396 420 ? S 12:13 0:00
>>>/var/qmail/bin/qmail-smtpd
>>>qscand 4248 0.1 0.4 6312 4488 ? S 12:13 0:00
>>>/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
>>>qscand 4252 0.1 0.4 6312 4488 ? S 12:13 0:00
>>>/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
>>>qmaild 4288 0.0 0.0 1400 424 ? S 12:13 0:00
>>>/var/qmail/bin/qmail-smtpd
>>>qscand 4290 0.1 0.4 6312 4488 ? S 12:13 0:00
>>>/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
>>>qmaild 4314 0.0 0.0 1400 424 ? S 12:13 0:00
>>>/var/qmail/bin/qmail-smtpd
>>>qscand 4315 0.1 0.4 6312 4488 ? S 12:13 0:00
>>>/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
>>>qmaild 4316 0.0 0.0 1396 420 ? S 12:13 0:00
>>>/var/qmail/bin/qmail-smtpd
>>>qscand 4324 0.1 0.4 6312 4488 ? S 12:13 0:00
>>>/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
>>>qmaild 4344 0.0 0.0 1400 424 ? S 12:14 0:00
>>>/var/qmail/bin/qmail-smtpd
>>>qscand 4347 0.1 0.4 6312 4488 ? S 12:14 0:00
>>>/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
>>>vpopmail 4370 0.0 0.0 1400 500 ? S 12:14 0:00
>>>/usr/local/courier-imap/bin/pop3d Maildir
>>>vpopmail 4371 0.0 0.0 1396 496 ? S 12:14 0:00
>>>/usr/local/courier-imap/bin/pop3d Maildir
>>>qmaild 4373 0.0 0.0 1396 420 ? S 12:14 0:00
>>>/var/qmail/bin/qmail-smtpd
>>>qscand 4374 0.1 0.4 6312 4488 ? S 12:14 0:00
>>>/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
>>>qmaild 4394 0.0 0.0 1396 420 ? S 12:14 0:00
>>>/var/qmail/bin/qmail-smtpd
>>>qscand 4397 0.2 0.4 6312 4488 ? S 12:14 0:00
>>>/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
>>>vpopmail 4401 0.0 0.0 1396 428 ? S 12:14 0:00
>>>/usr/local/courier-imap/bin/pop3d Maildir
>>>qmaild 4403 0.0 0.0 1400 424 ? S 12:14 0:00
>>>/var/qmail/bin/qmail-smtpd
>>>qscand 4406 0.2 0.4 6312 4488 ? S 12:14 0:00
>>>/usr/bin/perl -T /var/qmail/bin/qmail-scanner-queue.pl
>>>
>>>Please suggest something to resolve this problem. Its getting crazy
>>>with this
>>>
>>>Thanks
>>>Hemant
>>>
>>
>>How much resources are available on the system? You are accepting upto
>>450 simulteneous connections.
>>
>>Are you being spammed or virus mailings?
>>
>>Using the qmail-smtpd log, see if a pattern develops for the sending
>>mail servers.
>>
>>Try using -D -H in the qmail-smtpd's run file.
>>Will not be a delay of two seconds (-D)
>>Will not attempt to lookup the hostname (-H)
>>
>>The log you provide has no useful information.
>>
>>You need to see whether a pattern develops. Consult the qmail-send logs.
>>
>>Is your qmail-queue-scanner running in debug mode? Look through it and
>>see what that tells you.
>>
>>Likely issue is that the amount of mailing you began receiving is
>>exceeding the amount of mail your server/s can handle.
>>
>>AK
>
>

Normally qmail-queue-scanner will bail if it takes more then 20 minutes
to process. The sending server on the other hand, will no wait his long.

Are these message of a large size attachment?

It might be time to add another server to increase the email handling
capacity. Have you looked at qmailmrtg from www.inter7.com? This might
provide you a visual representation of what is going on on the system.

You will also likely need to determine what patches were applied to the
qmail installed.

AK

Hi AK,

Thanks for your reply and help.

The reason for delay in the emails was MTU setting at router end by the
ISP. Hotmail and Ebay were making connections but there was no data
transfers. It took me 3 - 4 days t0 figure it out and yesterday
everything came back to normal after the ISP fixed the same.

Thanks for your help
Hemant