process-accepted conflicts with some rosetta job

Bug #46559 reported by Celso Providelo
6
Affects Status Importance Assigned to Milestone
Launchpad itself
Fix Released
Critical
Carlos Perelló Marín

Bug Description

I't only happened once but was frustrating, process-accepted explodes on psycopg programming error (could not serialize operation).

It was processing ooffice translation (custom format as expected, using rosetta code from carlos), and it could not execute and UPDATE on TranslationImportQueueEntry.

Maybe we need to use a commom lockfile or redesign bits of the process ... don't know

Revision history for this message
Celso Providelo (cprov) wrote : Publisher Traceback

Relevant traceback.

Revision history for this message
Celso Providelo (cprov) wrote :

wishlist since we can live with it for now and the fix is outside soyuz scope.

Changed in soyuz:
assignee: nobody → cprov
status: Unconfirmed → Confirmed
Revision history for this message
Stuart Bishop (stub) wrote : Re: [Bug 46559] process-accepted conflicts with some rosetta job

Celso Providelo wrote:
> Private bug reported:
>
> I't only happened once but was frustrating, process-accepted explodes on
> psycopg programming error (could not serialize operation).

Serialization exceptions are normal and have to be handled, or you need to
use a lower transaction isolation level. Most likely all that needs doing is
  pass 'isolation=READ_COMMITTED' through to your initZopeless call, as you
rarely need the data consistency guaranteed by the serializable transaction
isolation level.

http://www.postgresql.org/docs/current/static/transaction-iso.html

 subscribe stub

--
Stuart Bishop <email address hidden> http://www.canonical.com/
Canonical Ltd. http://www.ubuntu.com/

Revision history for this message
Celso Providelo (cprov) wrote :

Thank you, stub.

I'll do some tests with READ_COMMITTED isolation level in mawson and see how it behaves.

Should I expect performance improvemements as well ?

Revision history for this message
Stuart Bishop (stub) wrote : Re: [Bug 46559] Re: process-accepted conflicts with some rosetta job

Celso Providelo wrote:

> Should I expect performance improvemements as well ?

Nope. Possibly a slow down, but that might just be rumour ;)

--
Stuart Bishop <email address hidden> http://www.canonical.com/
Canonical Ltd. http://www.ubuntu.com/

Revision history for this message
Celso Providelo (cprov) wrote :

Today it happened again, exactly the same issue, could make it work some time later.

Revision history for this message
Celso Providelo (cprov) wrote :

happened again .... nothing done yet.

Revision history for this message
Carlos Perelló Marín (carlos) wrote :

This will happen with high loads in Rosetta imports and right now we are doing the initialization of Edgy.

Revision history for this message
Matt Zimmerman (mdz) wrote :

This just caused cron.daily to fail, costing us an hour out of the tight schedule for 6.10 beta.

If there is an intensive Rosetta job running, I ask that it please be delayed until after the release. If not, perhaps this bug is more common than it is supposed.

Changed in soyuz:
importance: Wishlist → Medium
Revision history for this message
Matt Zimmerman (mdz) wrote :

It just happened a second time. We are unable to publish any packages in edgy now, and this is blocking all development including the preparation of the beta release.

Changed in soyuz:
importance: Medium → Critical
Revision history for this message
Matt Zimmerman (mdz) wrote :

My attempts to run cron.daily are failing consistently despite repeated attempts. I suspect there is a Rosetta job running somewhere, but I have no means to find out more.

James H. has suggested talking with stub when he wakes up.

Revision history for this message
Robert Collins (lifeless) wrote :

poimport was running. for future reference it runs as launchpad on gangotri.

Revision history for this message
Matt Zimmerman (mdz) wrote :

On an unrelated note, why is this bug marked private?

Revision history for this message
Stuart Bishop (stub) wrote :

We generally flag launchpad bugs private when they contain tracebacks, non-trivial code snippets or database schema descriptions to avoid leaking proprietary information. There is a line that when we cross causes people to freak and we don't quite know where that line is, so I tend to err on the side of caution.

Changed in soyuz:
assignee: cprov → carlos
status: Confirmed → In Progress
Revision history for this message
Celso Providelo (cprov) wrote :

The patch for fixing the Soyuz part goes attached.

Stub, can you please do a quick review for me ?

Changed in soyuz:
assignee: nobody → cprov
importance: Undecided → Critical
status: Unconfirmed → In Progress
Revision history for this message
Celso Providelo (cprov) wrote :

Soyuz part of the fix is landed in RF 4103

Changed in soyuz:
status: In Progress → Fix Committed
Revision history for this message
Carlos Perelló Marín (carlos) wrote :

Used the same solution as soyuz

Changed in rosetta:
status: In Progress → Fix Committed
Revision history for this message
Carlos Perelló Marín (carlos) wrote :

I got a problem with my merge, so it's not yet merged..

Changed in rosetta:
status: Fix Committed → In Progress
Revision history for this message
Carlos Perelló Marín (carlos) wrote :

The code is in rocketfuel now.

Changed in rosetta:
status: In Progress → Fix Committed
Revision history for this message
Celso Providelo (cprov) wrote :

soyuz part released some time ago

Changed in soyuz:
status: Fix Committed → Fix Released
Changed in rosetta:
status: Fix Committed → Fix Released
William Grant (wgrant)
visibility: private → public
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.