ubuntu-bug eucalyptus-common attaches massive files

Bug #541486 reported by Scott Moser
12
This bug affects 1 person
Affects Status Importance Assigned to Milestone
apport (Ubuntu)
Invalid
Undecided
Unassigned
Lucid
Invalid
Undecided
Unassigned
eucalyptus (Ubuntu)
Fix Released
Low
Dustin Kirkland 
Lucid
Fix Released
Low
Dustin Kirkland 

Bug Description

Once bug 520775 is fixed so that someone can successfully run it, running 'ubuntu-bug eucalyptus-common' (or any binary package with eucalyptus as source) will attach massive files in /var/log: axis2c.log cc.log cloud-debug.log cloud-output.log httpd-cc_error_log .

$ ls -h --size axis2c.log cc.log cloud-debug.log cloud-output.log httpd-cc_error_log | cat
 14M axis2c.log
 32M cc.log
9.3M cloud-debug.log
8.5M cloud-output.log
4.0K httpd-cc_error_log

The above is from a fairly idle cloud (2 systems, maybe 6 instances run ever, 4 images loaded).

I don't know if this is desirable or not. While the logs may be useful, it seems to me that uploading dozens of megabytes is just going to make the user less likely to use the tool.

ProblemType: Bug
.etc.eucalyptus.eucalyptus.cc.conf: CC_NAME="cluster1"
Architecture: amd64
Date: Thu Mar 18 15:35:56 2010
DistroRelease: Ubuntu 10.04
EasilyReproduced: Yes
Package: eucalyptus-common 1.6.2-0ubuntu13 [modified: usr/share/apport/package-hooks/source_eucalyptus.py]
ProcEnviron:
 LANG=en_US.UTF-8
 SHELL=/bin/bash
ProcVersionSignature: Ubuntu 2.6.32-16.25-server
SourcePackage: eucalyptus
UECDescSetup: No
Uname: Linux 2.6.32-16-server x86_64

Revision history for this message
Scott Moser (smoser) wrote :
Revision history for this message
Scott Moser (smoser) wrote :

(note, i manually modified /usr/share/apport/package-hooks/source_eucalyptus.py so I wouldn't get those attached here). If you want to see a full set of attachments, see bug 541470 .

Revision history for this message
Scott Moser (smoser) wrote :

Subscribing Matt, his initials are around the attachments of these files.

Matt, maybe you can add insight as to whether you think its sensible to attach such files ?

Revision history for this message
Matt Zimmerman (mdz) wrote :

According to the upstream developers at the time, it was considered appropriate to gather these logs for bug reports. Perhaps the real bug is that they are huge (not rotated often enough or too verbose by default)? Feel free to do as you feel is best with the apport hook in any case.

Separately, it might be nice if apport offered the option to selectively delete certain attachments where the submitter could be certain they were not relevant (or did not wish to disclose private data). I'll file a wishlist bug about that.

Revision history for this message
Matt Zimmerman (mdz) wrote :

(apport bug filed as bug 541517)

Revision history for this message
Thierry Carrez (ttx) wrote :

Agreed, we should not attach those files by default. Lots of people don't want to upload 34 Mb of log files when they report a bug, and it might indeed hinder the usage of the tool. Targeting to Lucid to keep it in scope.

Changed in eucalyptus (Ubuntu):
importance: Undecided → Low
status: New → Confirmed
Thierry Carrez (ttx)
Changed in eucalyptus (Ubuntu Lucid):
milestone: none → ubuntu-10.04-beta-2
Revision history for this message
Scott Moser (smoser) wrote :
Revision history for this message
Scott Moser (smoser) wrote :
Revision history for this message
Scott Moser (smoser) wrote :

I added an apport task, as I'd like to have this fixed by adding support for compression of files into hookutils of apport, and then use that in eucalyptus's hook.

See the attached 2 patches for my solution.

Revision history for this message
Martin Pitt (pitti) wrote :

Please note that Report objects (from the ProblemReport super class) already have that built in. To attach a file and force compression, do

  report['FooFile'] = ('/tmp/foo.log', True).

Please see

  python -c 'import problem_report; help(problem_report.ProblemReport)'

the "write" method.

Revision history for this message
Martin Pitt (pitti) wrote :

But aside from that, perhaps it might also make sense to preselect some interesting information on the hook side, or only attach the last 1 MB, or log entries from the last 24 hours?

Changed in apport (Ubuntu Lucid):
status: New → Invalid
Revision history for this message
Scott Moser (smoser) wrote :

I think at the moment we'll just want to attach the entire log. At some point the log files will hopefully be more reasonably sized by turning down debug output or such. Compression will turn 60M or so down into < 10, which isn't *too* bad.

Thanks for the report['FooFile'] syntax.

tags: added: patch
Revision history for this message
Scott Moser (smoser) wrote :

This patch contains the suggested fix, using Martin's suggestions.

Changed in eucalyptus (Ubuntu Lucid):
assignee: nobody → Dustin Kirkland (kirkland)
status: Confirmed → In Progress
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package eucalyptus - 1.6.2-0ubuntu21

---------------
eucalyptus (1.6.2-0ubuntu21) lucid; urgency=low

  * debian/source_eucalyptus.py (LP: #541486):
    - simplify questions to user.
    - give user option to not attach logs, compress them if attached.
 -- Scott Moser <email address hidden> Tue, 23 Mar 2010 18:06:20 -0400

Changed in eucalyptus (Ubuntu Lucid):
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.