Branch scanner jobs failing in bzrlib

Bug #719271 reported by Jeroen T. Vermeulen
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Launchpad itself
Won't Fix
Low
Unassigned

Bug Description

We've been seeing failures like OOPS-1863SSMS1 in the branch scanner, as well as the translations branch approver.

  ImportError: No module named http._urllib

Traceback (most recent call last):
  Module lp.services.scripts.base, line 91, in log_unhandled_exceptions_func
    return func(self, *args, **kw)
  Module lp.services.scripts.base, line 353, in lock_and_run
    implicit_begin=implicit_begin, isolation=isolation)
  Module lp.services.scripts.base, line 91, in log_unhandled_exceptions_func
    return func(self, *args, **kw)
  Module lp.services.scripts.base, line 311, in run
    self.main()
  Module lp.services.job.runner, line 480, in main
    job_source, self.dbuser, self.logger)
  Module lp.services.job.runner, line 255, in runFromSource
    with removeSecurityProxy(job_source.contextManager()):
  Module contextlib, line 16, in __enter__
    return self.gen.next()
  Module lp.code.model.branchjob, line 334, in contextManager
    cls.server = get_ro_server()
  Module lp.codehosting.vfs.branchfs, line 206, in get_ro_server
    get_transport(config.codehosting.internal_branch_by_id_root))
  Module bzrlib.transport, line 1602, in get_transport
  Module bzrlib.transport, line 1625, in _try_transport_factories
  Module bzrlib.registry, line 61, in get_obj
  Module bzrlib.registry, line 70, in _do_import
ImportError: No module named http._urllib

Ursula Junque (ursinha)
description: updated
Revision history for this message
Martin Pool (mbp) wrote :

Is this happening consistently or just (as the description implies) intermittently?

tags: added: branch-scanner bzr
description: updated
Revision history for this message
Robert Collins (lifeless) wrote :

Last seen: 2011-03-10 00:01:29 OOPS-1895SRSBR1

Revision history for this message
Martin Pool (mbp) wrote : Re: [Bug 719271] Re: Branch scanner jobs failing in bzrlib

On 17 March 2011 15:47, Robert Collins <email address hidden> wrote:
> Last seen: 2011-03-10 00:01:29 OOPS-1895SRSBR1

In that case it reminds me a bit of a bug where multiple threads
starting bzr simultaneously cause trouble with importing modules from
the registry. Is it possible there are multiple threads inside a
single scanner process?

Revision history for this message
Robert Collins (lifeless) wrote :

I'd need to check the code, but I don't think so. IIRC its run as a master-worker child using ampoule.

Revision history for this message
Aaron Bentley (abentley) wrote :

scan_branches currently uses the standard synchronous job runner, not the ampoule twisted job runner. It's supposed to be single-threaded, too.

Revision history for this message
Aaron Bentley (abentley) wrote :

The examples all seem to be happening on asuka, which is a staging server, so its oopses aren't critical. There are no examples of it happening on the production server, loganberry.

Changed in launchpad:
importance: Critical → Low
Revision history for this message
Robert Collins (lifeless) wrote :

I'm going to close this for now; we have no particular policy around staging, and we're going to be changing the staging environment anyone once we get some losa cycles.

Changed in launchpad:
status: Triaged → Won't Fix
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.