Document the workflow for removing obsolete suites from archive

Bug #86476 reported by Celso Providelo
4
Affects Status Importance Assigned to Milestone
Launchpad itself
Fix Released
High
Julian Edwards

Bug Description

Since warty and hoary have become obsolete, their files don't need to be part of the main archive anymore.

We should document a feasible workflow to remove them entirely from the archive and investigate its possible side-effects.

Tags: lp-soyuz
Revision history for this message
Celso Providelo (cprov) wrote :

Such workflow is particular important when we archive is reaching 264 G, like now.

Changed in soyuz:
assignee: nobody → cprov
importance: Undecided → High
status: Unconfirmed → In Progress
Revision history for this message
Celso Providelo (cprov) wrote :

It seems to be agreed that removal could be performed ad-hoc and directly on the DB for now.

The procedure consists of:

 * Move the PUBLISHED records in a given suite (DR/DAR & POCKET) to SUPERSEDED, i.e., it's is possible to remove only warty and keep warty-security if required.

 * Run 'process-death-row' (already part of the cron.daily)

All not-used superseded packages will be marked as PENDINGREMOVAL and will be deleted in 24 hours.

This procedure is under test in dogfood instance.

Revision history for this message
Celso Providelo (cprov) wrote :

A problem with the suggested workflow was identified: 'Stable' RELEASE pockets get skipped of domination.

It will require some code to force domination on 'Obsolete' RELEASE pockets, probably by not considering them 'Stable' anymore.

Revision history for this message
Celso Providelo (cprov) wrote :

RF 4056

Changed in soyuz:
status: In Progress → Fix Committed
Revision history for this message
Celso Providelo (cprov) wrote :

Pending removal on production.

Revision history for this message
Celso Providelo (cprov) wrote :

We will encapsulate the publishing records updates in a simple script (scripts/ftpmaster-tools/remove-distrorelease.py).

Changed in soyuz:
status: Fix Committed → In Progress
Revision history for this message
Celso Providelo (cprov) wrote :

It's not going to be sorted before 1.1.7. As agreed in a meeting with Kiko and Joey

Christian Reis (kiko)
Changed in soyuz:
milestone: 1.1.10 → 1.1.11
Christian Reis (kiko)
Changed in soyuz:
assignee: cprov → julian-edwards
Changed in soyuz:
milestone: 1.1.11 → 1.1.12
Revision history for this message
Julian Edwards (julian-edwards) wrote :

Fixed in RF 5327. See obsolete-distroseries.py which makes packages OBSOLETE, which deathrow will process.

Changed in soyuz:
status: In Progress → Fix Committed
Revision history for this message
Tom Haddon (mthaddon) wrote :

Is there anything special that's needed to be done for this besides waiting for the deployment? We're currently at 3% disk space free, so sooner than later would be good.

Revision history for this message
Julian Edwards (julian-edwards) wrote : Re: [Bug 86476] Re: Document the workflow for removing obsolete suites from archive

Tom Haddon wrote:
> Is there anything special that's needed to be done for this besides
> waiting for the deployment? We're currently at 3% disk space free, so
> sooner than later would be good.
>

There is a script to run that will make all the packages obsolete, where
possible, for the distroseries that we want to kill.

Since this is the first time it's been put into production, I will nurse
it through personally this time to make sure it doesn't blow anything up
and then I will show you the runes necessary to run it in the future.
It's not particularly difficult :)

Changed in soyuz:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Related blueprints

Remote bug watches

Bug watches keep track of this bug in other bug trackers.