Launchpad itself

Add xz-compressed archive indexes

Bug #1517510 reported by Colin Watson
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Launchpad itself
Fix Released
High
Colin Watson

Bug Description

We currently only provide {Packages,Sources,Translations-*}.{gz,bz2}. xz is generally a better compression format than bz2 and is usually preferred by Debian these days. I'd like to add xz support, and preferably drop bz2 support not too long afterwards.

Related branches

lp:~cjwatson/charms/trusty/ubuntu-repository-cache/xz-indexes
Review Queue (community): Needs Fixing (automated testing)
James Page: Needs Resubmitting
Diff: 12 lines (+1/-1)
1 file modified
templates/apache2/archive_ubuntu_com.conf (+1/-1)
lp:~cjwatson/launchpad/xz-indexes
William Grant: Approve (code)
Diff: 1108 lines (+318/-50)
15 files modified
lib/lp/archivepublisher/model/ftparchive.py (+19/-6)
lib/lp/archivepublisher/publishing.py (+7/-5)
lib/lp/archivepublisher/tests/apt-data/apt.conf (+90/-3)
lib/lp/archivepublisher/tests/apt-data/apt_conf_single_empty_suite_test (+15/-3)
lib/lp/archivepublisher/tests/test_ftparchive.py (+1/-1)
lib/lp/archivepublisher/tests/test_publisher.py (+44/-8)
lib/lp/archivepublisher/tests/test_repositoryindexfile.py (+41/-10)
lib/lp/archivepublisher/utils.py (+32/-10)
lib/lp/registry/configure.zcml (+2/-1)
lib/lp/registry/interfaces/distroseries.py (+10/-1)
lib/lp/registry/model/distroseries.py (+25/-0)
lib/lp/registry/tests/test_distroseries.py (+15/-1)
lib/lp/soyuz/enums.py (+15/-1)
setup.py (+1/-0)
versions.cfg (+1/-0)
Colin Watson (cjwatson)
tags: added: feature soyuz-publish
Changed in launchpad:
status: New → Triaged
importance: Undecided → High
assignee: nobody → Colin Watson (cjwatson)
Revision history for this message
Colin Watson (cjwatson) wrote :

I've proposed merges to (I believe) all the relevant bits of infrastructure which need to be changed first. The relevant internal RT ticket is https://portal.admin.canonical.com/86477.

We should also think about whether this applies to old series, or just >= xenial; my instinct is the latter, not least because we'd want to drop .bz2 fairly soon afterwards and that seems excessively intrusive for old series. But continuing to widen DistroSeries with even more boolean columns seems messy. How about perhaps adding a publishing_options (or similar) JSON column? We could then turn backports_not_automatic and include_long_descriptions into properties using that; those are only used by the DistroSeries webservice export, InitializeDistroSeries, and the publisher, and there's no need for them to be indexed or anything. That would make it easy to configure this kind of feature for this case and for the future.

Revision history for this message
Launchpad QA Bot (lpqabot) wrote :

Fixed in stable r17920 <http://bazaar.launchpad.net/~launchpad-pqm/launchpad/stable/revision/17920>.

tags: added: qa-needstesting
Changed in launchpad:
status: Triaged → Fix Committed
Revision history for this message
Colin Watson (cjwatson) wrote :

This is deployable and adding xz to index_compressors will work, but we need to deploy https://code.launchpad.net/~cjwatson/launchpad/ftparchive-cleanup-old-indexes/+merge/285428 before removing bzip2.

tags: added: qa-ok
removed: qa-needstesting
Revision history for this message
Colin Watson (cjwatson) wrote :

xenial now has xz indexes and no bz2 indexes.

Changed in launchpad:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.