OpenStack Compute (nova)

Instance terminate/create operations failure due to RPC problem

Bug #1079160 reported by Kravchenko Pavel
16
This bug affects 2 people
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Invalid
High
Unassigned

Bug Description

In multihost environment when one of the hosts dies (or looses network) terminate instance that runs on other host fails.
The problem starts in the call from compute.manager to network_api.get_instance_nw_info().
Similar error happens during instance creation. The creation fails on network allocation.
I believe that the source of the problem is in the rpc.impl_kombu.Connection.pool that holds the connection objects. The connections not been cleaned from the pool (as they do when the service dies normally) or removed by timeout.

See original description
Revision history for this message
Chuck Short (zulcss) wrote :

Which version are you using?

Changed in nova:
status: New → Incomplete
Revision history for this message
Kravchenko Pavel (kravchenko-pavel) wrote :

I'm using master, last time updated about 4 days ago. Is there a right way to check the exact version?

Revision history for this message
Michael Still (mikal) wrote :

Could you define multi-host for me here? Are we talking multiple nova-network installations?

Revision history for this message
Kravchenko Pavel (kravchenko-pavel) wrote :

Yes, the setup contains multiple hosts running nova-network. The error happens when one of those hosts looses connectivity.

Kravchenko Pavel (kravchenko-pavel)
Changed in nova:
status: Incomplete → New
Michael Still (mikal)
Changed in nova:
status: New → Triaged
importance: Undecided → High
Kravchenko Pavel (kravchenko-pavel)
summary: - Terminate instance failure
+ Instance terminate/create operations failure
description: updated
Kravchenko Pavel (kravchenko-pavel)
summary: - Instance terminate/create operations failure
+ Instance terminate/create operations failure due to RPC problem
Jian Wen (wenjianhn)
Changed in nova:
assignee: nobody → Jian Wen (wenjianhn)
Jian Wen (wenjianhn)
Changed in nova:
assignee: Jian Wen (wenjianhn) → nobody
Revision history for this message
Davanum Srinivas (DIMS) (dims-v) wrote :

Hi,

Can you please try this change? https://review.openstack.org/#/c/18711/

Revision history for this message
Davanum Srinivas (DIMS) (dims-v) wrote :

We cannot solve the issue you reported without more information. Could you try the suggested patch and let us know?

Changed in nova:
status: Triaged → Incomplete
Revision history for this message
Thierry Carrez (ttx) wrote :

This bug lacks the necessary information to effectively reproduce and fix it, therefore it has been closed. Feel free to reopen the bug by providing the requested information and set the bug status back to ''New''.

Changed in nova:
status: Incomplete → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.