On 2/17/2011 2:02 PM, Michael Hudson-Doyle wrote:
> On Thu, 17 Feb 2011 17:37:08 -0000, John A Meinel <email address hidden> wrote:
>> We talked about increasing the number of file handles, but when wgrant
>> tested that on his machine, it caused problems because 'select' doesn't
>> like more than 1024 handles, and python has some internal MAX_FD set, etc.
>
> If we're close to the select() limit in production, we should probably
> be using a different reactor *anyway*.
>
> This translates to passing -r poll or -r epoll to twistd, so I think it
> would be something the losas need to change in an init script. And test
> on staging first, etc etc.
>
> Cheers,
> mwh
>
Or end-run around it and go with haproxy load between multiple instances
and cap their concurrent requests to about 100 or so. Which has a lot of
other benefits.
John
=:->
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (Cygwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
On 2/17/2011 2:02 PM, Michael Hudson-Doyle wrote:
> On Thu, 17 Feb 2011 17:37:08 -0000, John A Meinel <email address hidden> wrote:
>> We talked about increasing the number of file handles, but when wgrant
>> tested that on his machine, it caused problems because 'select' doesn't
>> like more than 1024 handles, and python has some internal MAX_FD set, etc.
>
> If we're close to the select() limit in production, we should probably
> be using a different reactor *anyway*.
>
> This translates to passing -r poll or -r epoll to twistd, so I think it
> would be something the losas need to change in an init script. And test
> on staging first, etc etc.
>
> Cheers,
> mwh
>
Or end-run around it and go with haproxy load between multiple instances
and cap their concurrent requests to about 100 or so. Which has a lot of
other benefits.
John enigmail. mozdev. org/
=:->
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (Cygwin)
Comment: Using GnuPG with Mozilla - http://
iEYEARECAAYFAk1 dlV8ACgkQJdeBCY SNAANh3QCghFxN6 Y45YfR6u+ Y2BuHeLzGY WuE9RXBas+ d6vJgOCHIcuoOF
N0YAoNB/
=l/Dl
-----END PGP SIGNATURE-----