Ubuntu
sosreport package

[sru] Update sosreport to 3.8

Bug #1825010 reported by Eric Desrochers on 2019-04-16

This bug affects 2 people

	Status	Importance	Assigned to
sosreport (Debian)	Fix Released	Unknown	debbugs #939900
sosreport (Ubuntu)	Fix Released	Low	Eric Desrochers
Trusty	Won't Fix	Undecided	Unassigned
Xenial	Won't Fix	Low	Eric Desrochers
Bionic	Won't Fix	Low	Eric Desrochers
Cosmic	Won't Fix	Low	Eric Desrochers
Disco	Won't Fix	Low	Eric Desrochers
Eoan	Won't Fix	Low	Eric Desrochers
Focal	Fix Released	Medium	Eric Desrochers

Bug Description

[Impact]

sosreport 3.8 has been released including further enhancements in core sosreport functionality:
https://github.com/sosreport/sos/releases/tag/3.8

It would be great to find sosreport v3.8 in supported stable releases, considering the fact that the release (especially LTSes) will be supported for a couple of years still:

sosreport is widely use by Canonical support team to troubleshoot UA customer, other vendors and community users. These improvement will benefit all of them.

sosreport 3.8 contains a number of enhancements, new features, and bug fixes. (See "Release Note" below)

Just like we did for :
- v3.5 (LP: #1734983)
- v3.6 (LP: #1775195)

[Test Case]

* Install sosreport
* Run sosreport
- sosreport plugins are separated by subject (juju, MAAS, grub, zfs,...) and allow the capability to detect (based on file and package) if it exist and/or installed and then only run the necessary plugins based on the detection made.

It creates a files under /tmp in the form of :
/tmp/sosreport-sos38X-20190416160152.tar.xz # Actual sosreport
/tmp/sosreport-sos38X-20190416160152.tar.xz.md5 # MD5 checksum

Only accessible by root user:
-rw------- 1 root root 1619000 Apr 16 16:07 /tmp/sosreport-sos38X-20190416160152.tar.xz

Ideally, since we can't test all plugins, it would be good to have a few testers using different HW, kernel, installation with a focus on juju, MAAS, LXD, canonical-livepatch, ....

Looking for any error on the terminal while sosreport is running or post-sosreport run in /tmp/sosreport-*/sos_logs/

[Regression Potential]

* Risk is low.

* We did some dogfooding on sosreport, but we can't test each individual plugins and scenarios one by one, that would just be impossible but we have tested the ones we considered important and Ubuntu/Canonical related (canonical-livepatch, MAAS, juju, snappy), Openstack, mandatory file (logs, dmidecode, installed-debs and so on)

* Plugin bug is an eventuality, but they are usually easy to fix and the impact will be isolated to the plugin itself or section of the plugin. If a plugin has a bug the worst that could happen is that this particular plugin won't (or partially) collect information.

[Other information]

* Release note:
https://github.com/sosreport/sos/releases/tag/3.8

* Plugins:
sosreport contains in total: 284 plugins

- 185 plugins that used UbuntuPlugin and/or DebianPlugin that might been triggered at sosreport run.

- 97 plugins not using UbuntuPlugin and/or DebianPlugin. Basically useless in a Ubuntu context.

See original description

Tags:

Eric Desrochers (slashd) on 2019-04-16

tags:

added: sts

Eric Desrochers (slashd) on 2019-04-16

Changed in sosreport (Ubuntu Disco):
assignee:	nobody → Eric Desrochers (slashd)
Changed in sosreport (Ubuntu Cosmic):
assignee:	nobody → Eric Desrochers (slashd)
Changed in sosreport (Ubuntu Bionic):
assignee:	nobody → Eric Desrochers (slashd)
Changed in sosreport (Ubuntu Xenial):
assignee:	nobody → Eric Desrochers (slashd)
Changed in sosreport (Ubuntu Bionic):
importance:	Undecided → Low
Changed in sosreport (Ubuntu Cosmic):
importance:	Undecided → Low
Changed in sosreport (Ubuntu Disco):
importance:	Undecided → Low
summary:	- v3.7 is now the latest release + [sru] Backport of sosreport v3.7

Eric Desrochers (slashd) on 2019-04-16

description:

updated

Eric Desrochers (slashd) on 2019-04-16

description:	updated
description:	updated

Eric Desrochers (slashd) on 2019-04-16

description:

updated

Revision history for this message

Eric Desrochers (slashd) wrote on 2019-04-18: Re: [sru] Backport of sosreport v3.7

juju plugin bug:
https://github.com/sosreport/sos/issues/1653

Eric Desrochers (slashd) on 2019-04-18

description:

updated

Eric Desrochers (slashd) on 2019-04-26

description:

updated

Revision history for this message

Eric Desrochers (slashd) wrote on 2019-04-26:

debbug:
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=928049

Changed in sosreport (Ubuntu Trusty):
status:	New → Won't Fix
summary:	- [sru] Backport of sosreport v3.7 + [sru] new sosreport v3.7

Bug Watch Updater (bug-watch-updater) on 2019-04-26

Changed in sosreport (Debian):
status:	Unknown → New

Revision history for this message

Eric Desrochers (slashd) wrote on 2019-05-13: Re: [sru] new sosreport v3.7

Before pushing the sosreport v3.7 into Debian and Ubuntu. There is a couple of things that I want to see being merge upstream. The most important part is the refactoring of the juju plugin.

We had a discussion with security team about how they would drop privileges inside the juju plugin, and the decision was made that 'runuser -P' would be the best way.

-P or --pty is not available in Xenial as of today. I have reported a bug that I'm going to work on to add the PTY support. For more details see : (LP: #1828901)

Revision history for this message

Eric Desrochers (slashd) wrote on 2019-05-13:

@David Negreira, can you test your refactoring plugin with 'runuser -u juju-user -P <COMMAND>' ?

and see if it works as expected, for now the test will need to be done on Bionic and late due to what I have explained in comment #3.

Revision history for this message

Eric Desrochers (slashd) wrote on 2019-05-13:

@David Negreira, I want to make sure the runuser approach works before officially starting the SRU for this.

Eric Desrochers (slashd) on 2019-05-13

tags:

added: sosreport37

Revision history for this message

Eric Desrochers (slashd) wrote on 2019-08-27:

sosreport 3.8 has been released earlier today:
https://github.com/sosreport/sos/releases/tag/3.8

One blocker for Ubuntu is the juju plugin refactoring still waiting.
As soon as the juju plugin refactoring is completed/approved/merged, I'll go ahead and start to update debian/ubuntu w/ most likely 3.8 and I'll most likely skip 3.7. (tbd after the testing)

summary:

- [sru] new sosreport v3.7
+ [sru] Update sosreport to 3.7 || 3.8

Revision history for this message

Eric Desrochers (slashd) wrote on 2019-09-09: Re: [sru] Update sosreport to 3.7 || 3.8

Debian/sosreport 3.8 has been uploaded into mentor debian, waiting for sponsorship:
https://mentors.debian.net/package/sosreport

Eric Desrochers (slashd) on 2019-09-09

summary:

- [sru] Update sosreport to 3.7 || 3.8
+ [sru] Update sosreport to 3.8

Eric Desrochers (slashd) on 2019-09-09

no longer affects:

sosreport (Debian)

Eric Desrochers (slashd) on 2019-09-09

description:

updated

Bug Watch Updater (bug-watch-updater) on 2019-09-10

Changed in sosreport (Debian):
status:	Unknown → New

Bug Watch Updater (bug-watch-updater) on 2019-09-16

Changed in sosreport (Debian):
status:	New → Fix Released

Revision history for this message

Eric Desrochers (slashd) wrote on 2019-09-16:

sosreport 3.8 have been accepted into debian unstable.

As a first step, I'll upload sosreport 3.8 in the next active development release (F-series) when the cycle will start, and then will wait as mentioned earlier for the juju plugin(s) refactoring to be merged before updating any stable releases.

Eric Desrochers (slashd) on 2019-10-18

description:

updated

Eric Desrochers (slashd) on 2019-10-25

Changed in sosreport (Ubuntu Focal):
status:	In Progress → Fix Committed

Revision history for this message

Launchpad Janitor (janitor) wrote on 2019-10-25:

#10

This bug was fixed in the package sosreport - 3.8-1ubuntu1

---------------
sosreport (3.8-1ubuntu1) focal; urgency=low

* Merge from Debian unstable. Remaining changes: (LP: #1825010)
- Patch renamed to d/p/0001-split-lastlog-per-uid-ranges.patch

  * Additional patches:
   - d/p/0002-snappy-check-for-connectivity-to-the-snapstore.patch
   - d/p/0003-lxd-support-lxd-3.0.x.patch
   - d/p/0004-grafana-updates-debian-ubuntu.patch
   - d/p/0005-k8s-enable-plugin-for-ubuntu-CDK.patch
   - d/p/0006-k8s-separate-redhat-and-ubuntu.patch
   - d/p/0007-juju-dont-restart-juju-db-service.patch
   - d/p/0008-debian-archive-name-friendly.patch

-- Eric Desrochers <email address hidden> Sun, 15 Sep 2019 15:44:14 +0000

Changed in sosreport (Ubuntu Focal):
status:	Fix Committed → Fix Released

Revision history for this message

Launchpad Janitor (janitor) wrote on 2019-11-12:

#11

Status changed to 'Confirmed' because the bug affects multiple users.

Changed in sosreport (Ubuntu Bionic):
status:	New → Confirmed
Changed in sosreport (Ubuntu Cosmic):
status:	New → Confirmed
Changed in sosreport (Ubuntu Disco):
status:	New → Confirmed
Changed in sosreport (Ubuntu Xenial):
status:	New → Confirmed

Eric Desrochers (slashd) on 2019-11-12

Changed in sosreport (Ubuntu Cosmic):
status:	Confirmed → Won't Fix

Eric Desrochers (slashd) on 2019-12-11

Changed in sosreport (Ubuntu Disco):
status:	Confirmed → Won't Fix
Changed in sosreport (Ubuntu Xenial):
status:	Confirmed → Won't Fix
Changed in sosreport (Ubuntu Bionic):
status:	Confirmed → In Progress
Changed in sosreport (Ubuntu Xenial):
status:	Won't Fix → In Progress
importance:	Undecided → Low

Revision history for this message

Eric Desrochers (slashd) wrote on 2019-12-13:

#15

There is currently an upstream discussion about a potential new sosreport (v3,9) release before Focal Freeze schedule (Feb 27th).

https://github.com/sosreport/sos/issues/1892

Eric Desrochers (slashd) on 2020-01-29

summary:

- [sru] Update sosreport to 3.8
+ [sru] Update sosreport to 3.9

Eric Desrochers (slashd) on 2020-02-11

tags:	removed: sosreport37
summary:	- [sru] Update sosreport to 3.9 + [sru] Update sosreport to 3.8
Changed in sosreport (Ubuntu Xenial):
status:	In Progress → Won't Fix
Changed in sosreport (Ubuntu Bionic):
status:	In Progress → Won't Fix
Changed in sosreport (Ubuntu Eoan):
status:	In Progress → Won't Fix