[courier-users] Incoming messages hit the limits

This is a discussion on [courier-users] Incoming messages hit the limits within the Courier-Imap forums, part of the Mail Servers and Related category; Hello, I have hit the limits of my ISPs mailserver while subscribing to the Debian BTS and the queue was ...


Go Back   Usenet Forums > Mail Servers and Related > Courier-Imap

FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1 (permalink)  
Old 05-18-2008
Michelle Konzack
 
Posts: n/a
Default [courier-users] Incoming messages hit the limits

Hello,

I have hit the limits of my ISPs mailserver while subscribing to the
Debian BTS and the queue was runing for over 4000 messages at once.

Q 1: If a customer use my "courier-mta" as relay, how can I limit the
outgoing queue to for example 1 message in 10 seconds?

Q 2: The Debian BTS received my messages (647) over 2 hours and then
there is nothing for a long time and then it send out 1294
messages in batch at once... which can hit the incoming queue.
Is there a possibility to delay the threatment of the incoming
queue?

Thanks, Greetings and nice Day
Michelle Konzack
Systemadministrator
24V Electronic Engineer
Tamay Dogan Network
Debian GNU/Linux Consultant


--
Linux-User #280138 with the Linux Counter, http://counter.li.org/
##################### Debian GNU/Linux Consultant #####################
Michelle Konzack Apt. 917 ICQ #328449886
+49/177/9351947 50, rue de Soultz MSN LinuxMichi
+33/6/61925193 67100 Strasbourg/France IRC #Debian (irc.icq.com)

-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
courier-users mailing list
courier-users@lists.sourceforge.net
Unsubscribe: https://lists.sourceforge.net/lists/.../courier-users

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.1 (GNU/Linux)

iD8DBQFIL1VfC0FPBMSS+BIRAlklAKCSYHcrdY1PoCsXIcT0jV A4HU5qiQCeOHpd
bbdxNmtbF5M8RKGpJvplOYI=
=mmPA
-----END PGP SIGNATURE-----

Reply With Quote
  #2 (permalink)  
Old 05-18-2008
Sam Varshavchik
 
Posts: n/a
Default Re: [courier-users] Incoming messages hit the limits

Michelle Konzack writes:

> Hello,
>
> I have hit the limits of my ISPs mailserver while subscribing to the
> Debian BTS and the queue was runing for over 4000 messages at once.
>
> Q 1: If a customer use my "courier-mta" as relay, how can I limit the
> outgoing queue to for example 1 message in 10 seconds?


There's no such rate limiting option available. Courier will, generally,
send mail at the first available attempt. There is an upper limit, but it's
a different one. Courier will, by default, open no more than four separate
connections to the same destination domain (could be different individual
MXs, or a single MX). Any additional messages to the domain gets held until
one of the existing connections finishes delivering its message.

> Q 2: The Debian BTS received my messages (647) over 2 hours and then
> there is nothing for a long time and then it send out 1294
> messages in batch at once... which can hit the incoming queue.
> Is there a possibility to delay the threatment of the incoming
> queue?


Not sure what you mean. Courier itself will accept a maximum of 5
simultaneous connections from the same /24's worth of IPs, and/or up to 5
simultaneous connections from a single IP address. That's set in the esmtpd
configuration file. That's the only available rate limiting.


-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
courier-users mailing list
courier-users@lists.sourceforge.net
Unsubscribe: https://lists.sourceforge.net/lists/.../courier-users

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.7 (GNU/Linux)

iD8DBQBIMEImx9p3GYHlUOIRAm09AJ97Qn/rKYsxtY+U5QycQryWZ6B6kgCdGBmY
5X6Ne8FjtvHj0Ev2SGUG5bY=
=wTHF
-----END PGP SIGNATURE-----

Reply With Quote
  #3 (permalink)  
Old 05-19-2008
Michelle Konzack
 
Posts: n/a
Default Re: [courier-users] Incoming messages hit the limits

Hello Sam,

thank you for your answer.

It seems that I must shutdonw "courier-mta" for the benefit
of "exim" which i realy do not like after along period. :-(

Thanks, Greetings and nice Day
Michelle Konzack
Systemadministrator
24V Electronic Engineer
Tamay Dogan Network
Debian GNU/Linux Consultant


--
Linux-User #280138 with the Linux Counter, http://counter.li.org/
##################### Debian GNU/Linux Consultant #####################
Michelle Konzack Apt. 917 ICQ #328449886
+49/177/9351947 50, rue de Soultz MSN LinuxMichi
+33/6/61925193 67100 Strasbourg/France IRC #Debian (irc.icq.com)

-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
courier-users mailing list
courier-users@lists.sourceforge.net
Unsubscribe: https://lists.sourceforge.net/lists/.../courier-users

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.1 (GNU/Linux)

iD8DBQFIMKlLC0FPBMSS+BIRAuHsAJ9M1fN1g64tTXtpd6pnjK kKSWE2OwCgm4dd
LFhy/TMSgJWyQhuz7Al30ag=
=iqoj
-----END PGP SIGNATURE-----

Reply With Quote
  #4 (permalink)  
Old 05-19-2008
Esa
 
Posts: n/a
Default Re: [courier-users] Incoming messages hit the limits

On 19.5.2008 17:50, Michelle Konzack wrote:
> It seems that I must shutdonw "courier-mta" for the benefit
> of "exim" which i realy do not like after along period. :-(
>

You're paying for the service, right? Why not raise the issue with the
ISP, then, since obviously the service you're paying for doesn't fit
your needs?

esa


-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
courier-users mailing list
courier-users@lists.sourceforge.net
Unsubscribe: https://lists.sourceforge.net/lists/.../courier-users

Reply With Quote
  #5 (permalink)  
Old 05-19-2008
Michelle Konzack
 
Posts: n/a
Default Re: [courier-users] Incoming messages hit the limits

Am 2008-05-19 19:43:41, schrieb Esa:
> On 19.5.2008 17:50, Michelle Konzack wrote:
> > It seems that I must shutdonw "courier-mta" for the benefit
> > of "exim" which i realy do not like after along period. :-(
> >

> You're paying for the service, right? Why not raise the issue with the
> ISP, then, since obviously the service you're paying for doesn't fit
> your needs?

------------------------ END OF REPLIED MESSAGE ------------------------

Not realy, I pay only for the STM-4 in Paris but
the AS-Router and the servers are my own... :-)

Thanks, Greetings and nice Day
Michelle Konzack
Systemadministrator
Tamay Dogan Network
Debian GNU/Linux Consultant


--
Linux-User #280138 with the Linux Counter, http://counter.li.org/
##################### Debian GNU/Linux Consultant #####################
Michelle Konzack Apt. 917 ICQ #328449886
+49/177/9351947 50, rue de Soultz MSN LinuxMichi
+33/6/61925193 67100 Strasbourg/France IRC #Debian (irc.icq.com)

-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
courier-users mailing list
courier-users@lists.sourceforge.net
Unsubscribe: https://lists.sourceforge.net/lists/.../courier-users

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.1 (GNU/Linux)

iD8DBQFIMb5YC0FPBMSS+BIRAtoBAKCVWaapEegGpC4N7aPQ53 Qclu9mawCeM6Rd
wJfmaSkSWsNP8zB2MF2KHew=
=8JRv
-----END PGP SIGNATURE-----

Reply With Quote
  #6 (permalink)  
Old 05-20-2008
Alessandro Vesely
 
Posts: n/a
Default Re: [courier-users] Incoming messages hit the limits

Michelle Konzack wrote:
>
> It seems that I must shutdonw "courier-mta" for the benefit
> of "exim" which i realy do not like after along period. :-(


What kind of control does exim allow on in/out messages?

On a different level, you might control output messages rates by
configuring traffic control with a queue discipline other than
pfifo_fast. That would limit IP packets rather than SMTP messages.
OTOH, I don't think you know how long the queue is getting at your
ISP's, therefore you cannot control the shape of that curve anyway.

Out of curiosity, may I ask why you don't deliver mail directly?




























































































-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
courier-users mailing list
courier-users@lists.sourceforge.net
Unsubscribe: https://lists.sourceforge.net/lists/.../courier-users

Reply With Quote
  #7 (permalink)  
Old 05-21-2008
Michelle Konzack
 
Posts: n/a
Default Re: [courier-users] Incoming messages hit the limits

Hello Alessandro,

Am 2008-05-20 06:37:58, schrieb Alessandro Vesely:
> What kind of control does exim allow on in/out messages?


I have seen a setup, if a client send out a message to ONE destination,
over a SMTP-Relay (= exim = ME) and there are too much messages, the
messages would be troddled and not send @once...

> On a different level, you might control output messages rates by
> configuring traffic control with a queue discipline other than
> pfifo_fast. That would limit IP packets rather than SMTP messages.
> OTOH, I don't think you know how long the queue is getting at your
> ISP's, therefore you cannot control the shape of that curve anyway.
>
> Out of curiosity, may I ask why you don't deliver mail directly?


The other thing is, that the Debian BTS has hit the limits on the Mail-
Server of my current hosting provider... there where over 4000 messages
in the (postfix) queue waiting. It was between Friday and Saturday
last week and I have load the server more then all other customers in
the last week. (He has send me a graphical statistic from it)

I do not know which server hardware he use, but my "Zenith Data Systems
Express 5800 MH4500R" (4x Xeon 550 with 2 GByte of memory and 6 SCA hdd)
would handel this traffic... while half sleeping.

However, since there is DSPAM running on his the host it may be
different. I am using clamav-ng and spamassassin and have no problems.

Since I am planning to host my own server at him, I like to configure my
inbound MTA to check only <zen.spamhaus.org> on SMTP level (hit over 60%
of all incoming spam) and reject if hit. The rest should goes into a
queue (which should prevent the overload of the server) for local
delivery over procmail where $USER have there own filtering setup...

Note: The Server I want to install will get normaly arround 20-40.000
messages per day including spam and if I get more, the there is
a problem... and I am over-spamed!

Since the Server will hols courier-imap, $MTA, postgresql 8.3,
apache2 the Server should be responsive in any situations,
mean, a Spam-DoS should not hit my server and Business.

(Normaly I should install 3-4 separated servers but this would
hit my purse a little bit to much...)

Oh yes, I have already put following stuff into my

----[ '~/.procmailrc' ]-----------------

LOCKFILE=${HOME}/.procmailrc.lock

:0
* > 250000
.ATTENTION.big_messages/

:0fw
* < 250000
| /usr/bin/spamc

----------------------------------------

where the LOCKFILE would serialize the proceeding of the incoming
messages, speek, if the ~/.procmailrc is running, no second message is
accepted and the MTA try the re-deliver it later. Also this mean, that
only one spamassassin process is running per $USER (where I have 43).

Thanks, Greetings and nice Day
Michelle Konzack
Systemadministrator
24V Electronic Engineer
Tamay Dogan Network
Debian GNU/Linux Consultant


--
Linux-User #280138 with the Linux Counter, http://counter.li.org/
##################### Debian GNU/Linux Consultant #####################
Michelle Konzack Apt. 917 ICQ #328449886
+49/177/9351947 50, rue de Soultz MSN LinuxMichi
+33/6/61925193 67100 Strasbourg/France IRC #Debian (irc.icq.com)

-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
courier-users mailing list
courier-users@lists.sourceforge.net
Unsubscribe: https://lists.sourceforge.net/lists/.../courier-users

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.1 (GNU/Linux)

iD8DBQFIM1ZxC0FPBMSS+BIRAhkDAJ4jIJQCaj2IWCwfURFFPe q29dZQawCgnpaH
16pcaGX+l/k3YEvObzz0Xmw=
=w6ar
-----END PGP SIGNATURE-----

Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are Off
[IMG] code is Off
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT +1. The time now is 06:43 AM.


Powered by vBulletin® Version 3.6.8
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO 3.0.0