If the issue is that the l3-agent is timing out waiting on an rpc-response, have you tried increasing the rpc_response_timeout value in neutron.conf to something higher?
If the issue is that the l3-agent is timing out waiting on an rpc-response, have you tried increasing the rpc_response_ timeout value in neutron.conf to something higher?