Delete service/deployment causes exception

Bug #1714204 reported by Yossi Boaron
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kuryr-kubernetes
Fix Released
Medium
Yossi Boaron

Bug Description

Steps to reproduce :

1. kubectl run echoserver --image=gcr.io/google_containers/echoserver:1.4 --port=8080 --replicas=2

2. kubectl expose deployment echoserver

3. Verify that relevant openstack loadbalancer is in ACTIVE state

4. kubectl delete service echoserver

5. kubectl delete deployment echoserver

Observation :

From kuryr.log :


Aug 31 06:39:41 xxcc python[20455]: 2017-08-31 06:39:41.108 20455 ERROR kuryr_kubernetes.handlers.logging [-] Failed to handle event {u'object': {u'kind': u'Endpoints', u'subsets': [{u'addresses': [{u'ip': u'10.
Aug 31 06:39:41 xxcc python[20455]: t.data": {"id": "81c312d2-3c31-43c5-91e5-7799ea5df6ba", "ip": "10.0.0.162", "name": "default/echoserver", "project_id": "00c30d1812a04edca0d7349a1191948d", "subnet_id": "0ef33
Aug 31 06:39:41 xxcc python[20455]: ne
Aug 31 06:39:41 xxcc python[20455]: 2017-08-31 06:39:41.108 20455 ERROR kuryr_kubernetes.handlers.logging Traceback (most recent call last):
Aug 31 06:39:41 xxcc python[20455]: 2017-08-31 06:39:41.108 20455 ERROR kuryr_kubernetes.handlers.logging File "/opt/stack/kuryr-kubernetes/kuryr_kubernetes/handlers/logging.py", line 37, in __call__
Aug 31 06:39:41 xxcc python[20455]: 2017-08-31 06:39:41.108 20455 ERROR kuryr_kubernetes.handlers.logging self._handler(event)
Aug 31 06:39:41 xxcc python[20455]: 2017-08-31 06:39:41.108 20455 ERROR kuryr_kubernetes.handlers.logging File "/opt/stack/kuryr-kubernetes/kuryr_kubernetes/handlers/retry.py", line 61, in __call__
Aug 31 06:39:41 xxcc python[20455]: 2017-08-31 06:39:41.108 20455 ERROR kuryr_kubernetes.handlers.logging self._handler(event)
Aug 31 06:39:41 xxcc python[20455]: 2017-08-31 06:39:41.108 20455 ERROR kuryr_kubernetes.handlers.logging File "/opt/stack/kuryr-kubernetes/kuryr_kubernetes/handlers/k8s_base.py", line 65, in __call__
Aug 31 06:39:41 xxcc python[20455]: 2017-08-31 06:39:41.108 20455 ERROR kuryr_kubernetes.handlers.logging self.on_deleted(obj)
Aug 31 06:39:41 xxcc python[20455]: 2017-08-31 06:39:41.108 20455 ERROR kuryr_kubernetes.handlers.logging File "/opt/stack/kuryr-kubernetes/kuryr_kubernetes/controller/handlers/lbaas.py", line 239, in on_delet
Aug 31 06:39:41 xxcc python[20455]: 2017-08-31 06:39:41.108 20455 ERROR kuryr_kubernetes.handlers.logging obj_lbaas.LBaaSServiceSpec())
Aug 31 06:39:41 xxcc python[20455]: 2017-08-31 06:39:41.108 20455 ERROR kuryr_kubernetes.handlers.logging File "/opt/stack/kuryr-kubernetes/kuryr_kubernetes/controller/handlers/lbaas.py", line 270, in _sync_lb
Aug 31 06:39:41 xxcc python[20455]: 2017-08-31 06:39:41.108 20455 ERROR kuryr_kubernetes.handlers.logging if self._add_new_members(endpoints, lbaas_state, lbaas_spec):
Aug 31 06:39:41 xxcc python[20455]: 2017-08-31 06:39:41.108 20455 ERROR kuryr_kubernetes.handlers.logging File "/opt/stack/kuryr-kubernetes/kuryr_kubernetes/controller/handlers/lbaas.py", line 302, in _add_new
Aug 31 06:39:41 xxcc python[20455]: 2017-08-31 06:39:41.108 20455 ERROR kuryr_kubernetes.handlers.logging pool = pool_by_tgt_name[port_name]
Aug 31 06:39:41 xxcc python[20455]: 2017-08-31 06:39:41.108 20455 ERROR kuryr_kubernetes.handlers.logging KeyError: None
Aug 31 06:39:41 xxcc python[20455]: 2017-08-31 06:39:41.108 20455 ERROR kuryr_kubernetes.handlers.logging
Aug 31 0

Changed in kuryr-kubernetes:
status: New → Triaged
importance: Undecided → Medium
assignee: nobody → yossib (yossi-boaron-1234)
Changed in kuryr-kubernetes:
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kuryr-kubernetes (master)

Reviewed: https://review.openstack.org/512636
Committed: https://git.openstack.org/cgit/openstack/kuryr-kubernetes/commit/?id=cfdc99134995bf129ef6f0726df7cd5c7817cdd6
Submitter: Zuul
Branch: master

commit cfdc99134995bf129ef6f0726df7cd5c7817cdd6
Author: Yossi Boaron <email address hidden>
Date: Tue Oct 17 17:12:16 2017 +0300

    Fix KeyError exception upon service/deployment deletion

    When service/deployment being deleted KeyError exception is reported,
    this patch solve this issue.

    Closes-Bug: #1714204

    Change-Id: I701416fd8666e8723847046e83f5dd12bc1e7370

Changed in kuryr-kubernetes:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kuryr-kubernetes 0.3.0

This issue was fixed in the openstack/kuryr-kubernetes 0.3.0 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.