Minimize agent state reports handling on server side

Bug #1573843 reported by Oleg Bondarev
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
neutron
Expired
Wishlist
Unassigned

Bug Description

Agent state reports are mostly needed in order for neutron server to properly (re)schedule resources among agents.
New features may require more precise scheduling which in turn requires agents to report more and servers to handle more data.

However adding new logic to agent state reports handling has negative effect on scalability and overall neutron server performance. Here is one of examples: https://bugs.launchpad.net/neutron/+bug/1567497 with more cases possibly coming in future: like https://review.openstack.org/#/c/285548 which is adding a new db update request for each state report.

One of the things that could be done is to not include (or just to ignore on server side) the data which can't be changed during runtime (like config parameters) in each state report. Such data should only be processed on agent (re)start/revival.
So mainly it's about separating static and dynamic data in state reports handling to reduce the amount of db updates.

Tags: loadimpact
Doug Wiegley (dougwig)
Changed in neutron:
status: New → Confirmed
importance: Undecided → Wishlist
summary: - Minimize agent state reports handling on server side
+ [rfe] Minimize agent state reports handling on server side
tags: added: rfe
Revision history for this message
Armando Migliaccio (armando-migliaccio) wrote : Re: [rfe] Minimize agent state reports handling on server side

If the goal is simply to reduce the payload of the periodic status report, I would be interested in seeing how you intend to break this down and make sure that no further changes break that pattern. This raises the interesting question on bw compatibility, but maybe not. Having said, I wonder if this can be tackled in the context of [1]. Thoughts?

[1] https://blueprints.launchpad.net/neutron/+spec/push-notifications

Changed in neutron:
status: Confirmed → Triaged
Revision history for this message
Armando Migliaccio (armando-migliaccio) wrote :
tags: removed: rfe
summary: - [rfe] Minimize agent state reports handling on server side
+ Minimize agent state reports handling on server side
Revision history for this message
Armando Migliaccio (armando-migliaccio) wrote :

I think the discussion is best moved in Gerrit and code review.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to neutron (master)

Fix proposed to branch: master
Review: https://review.openstack.org/319957

Changed in neutron:
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on neutron (master)

Change abandoned by Armando Migliaccio (<email address hidden>) on branch: master
Review: https://review.openstack.org/319957
Reason: This review is > 4 weeks without comment, and failed Jenkins the last time it was checked. We are abandoning this for now. Feel free to reactivate the review by pressing the restore button and leaving a 'recheck' comment to get fresh test results.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Change abandoned by Armando Migliaccio (<email address hidden>) on branch: master
Review: https://review.openstack.org/320360
Reason: This review is > 4 weeks without comment, and failed Jenkins the last time it was checked. We are abandoning this for now. Feel free to reactivate the review by pressing the restore button and leaving a 'recheck' comment to get fresh test results.

Changed in neutron:
status: In Progress → Incomplete
assignee: Oleg Bondarev (obondarev) → nobody
Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for neutron because there has been no activity for 60 days.]

Changed in neutron:
status: Incomplete → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.