Ubuntu
libreoffice package

[precise] Saving xls files originally created in Excel 2003 causes considerable increase of file size

Bug #1194740 reported by Nobuto Murata on 2013-06-26

This bug affects 2 people

	Status	Importance	Assigned to
LibreOffice	Fix Released	Medium	freedesktop-bugs #51878
libreoffice (Ubuntu)	Fix Released	Medium	Unassigned
Precise	Fix Released	Medium	Björn Michaelsen

Bug Description

WORKAROUND: -> https://launchpad.net/~libreoffice/+archive/ppa

This is a regression in upstream between 3.5.4 and 3.5.5.

[Impact]
when opening a received xls created by Microsoft Excel 2003, then saving as xls again by LibreOffice,
file size becomes considerably larger.
i.e. 32KB -> 1.4MB (40x larger)

[Test Case]

A. to confirm the regression is fixed
1. open the xls file(32KB) attached in upstream bug
https://bugs.freedesktop.org/attachment.cgi?id=64725
2. save it as xls in LibreOffice Calc
3. confirm that the file size becomes almost 1.4MB
4. update to -proposed
5. open the file in the upstream bug again and save it as xls
6. confirm that the file size is almost the same as the original(32KB)

B. to confirm not happening another regression
1. create a new document in LibreOffice Calc
2. make the height of A5 cell 50mm
3. focus to A5 cell
4. save as xls and close the document
5. open the xls file again
6. confirm that the height of A5 cell is 50mm, the height of other rows stay default height.

above steps of B1.-6. should be tested with both current and -proposed version

Note: with 3.5.4 or lower version, when opening the xls file again in step 5, the height of all cells becomes 50mm.

[Regression Potential]
the patch causing this regression was intended to fix fdo#50304.
https://bugs.freedesktop.org/show_bug.cgi?id=50304
to prevent fdo#50304 from happening again by this SRU, additional test case is described above.

ProblemType: BugDistroRelease: Ubuntu 12.04
Package: libreoffice-calc 1:3.5.7-0ubuntu4
ProcVersionSignature: Ubuntu 3.5.0-23.35~precise1-generic 3.5.7.2
Uname: Linux 3.5.0-23-generic x86_64
ApportVersion: 2.0.1-0ubuntu17.1
Architecture: amd64
CasperVersion: 1.315.1
Date: Wed Jun 26 06:35:48 2013
LiveMediaBuild: Ubuntu 12.04.2 LTS "Precise Pangolin" - Release amd64 (20130213)
MarkForUpload: True
ProcEnviron:
TERM=xterm
PATH=(custom, no user)
LANG=ja_JP.UTF-8
SHELL=/bin/bashSourcePackage: libreoffice
UpgradeStatus: No upgrade log present (probably fresh install)

See original description

Tags:

Revision history for this message

In freedesktop.org Bugzilla #51200, Andis (andis-lazdins) wrote on 2012-06-18:

Created attachment 63167
compressed large .xls file saved initially by Libreoffice 3.5.5.1

I found this problem trying to work with time sheets originally created and edited with Excel 2003. The file originally having size of about 100 KB after saving in LibreOffice as .xls increases in size to 7.6 MB. After saving the same file as .xls with OpenOffice.org 3.4 file size goes down to some 80 KB. The same happens if previously created large .xls file is saved as .ods with Libreoffice 3.5.5.1.

If I reopen .xls file saved in Openoffice.org with Libreoffice 3.5.5.1 and save it again as .xls, file size is not increasing, however saving is very slow.

Sample files follows in attachment:
Large xls file size.xls.zip - compressed large .xls file saved initially by Libreoffice 3.5.5.1
Large xls file size.ods - the same file saved by by Libreoffice 3.5.5.1 as .ods
Large xls file size ooo.xls - large xls file saved as xls by Openoffice.org 3.4
Large xls file size ooo + lo.xls - the same file saved by Libreoffice 3.5.5.1 after saving in Openoffice.org

Revision history for this message

In freedesktop.org Bugzilla #51200, Andis (andis-lazdins) wrote on 2012-06-18:

Created attachment 63168
The same file saved by Openoffice.org 3.4 after Libreoffice 3.5.5.1

Revision history for this message

In freedesktop.org Bugzilla #51200, Andis (andis-lazdins) wrote on 2012-06-18:

Created attachment 63169
The same file saved by Libreoffice 3.5.5.1 after saving with Openoffice.org 3.4

Revision history for this message

In freedesktop.org Bugzilla #51200, Andis (andis-lazdins) wrote on 2012-06-18:

Created attachment 63170
Initial large .xls file saved by Libreoffice 3.5.5.1 as ods

Revision history for this message

In freedesktop.org Bugzilla #51200, Markus Mohrhard (moggi) wrote on 2012-07-05:

Should be fixed in 3.5.5.2 and 3.6.0.1

Revision history for this message

In freedesktop.org Bugzilla #51200, Andis (andis-lazdins) wrote on 2012-07-05:

The bug is fixed now in 3.5.5.2.

Revision history for this message

In freedesktop.org Bugzilla #51878, Frob-c (frob-c) wrote on 2012-07-08:

#16

Created attachment 63989
File to reproduce the problem

Resave attached file (~13Kb) as XLS from LO Calc 3.5.5 or newer (including 3.6beta2). Result would be ~1.3Mb.

Original file has reduced heights for all rows after row 42.
In original XLS it's stored as 'DefaultRowHeight' record and a few 'row' records for non-empty rows (some of the first 42).

LO Calc saves it with different value for 'DefaultRowHeight' and million of 'row' records.

LO Calc 3.5.3 saves it without this problem.

Workaround: change height of all non-used rows to default one.

"<moggi> http://cgit.freedesktop.org/libreoffice/core/commit/sc?h=libreoffice-3-5-5&id=c9749c917e67a70a0cb283e180fd1c05f0cf3c2a"

Revision history for this message

In freedesktop.org Bugzilla #51878, Frob-c (frob-c) wrote on 2012-07-13:

#17

52029 could be related to this one.

Revision history for this message

In freedesktop.org Bugzilla #51200, Zenonbybloch (zenonbybloch) wrote on 2012-07-14:

Problem still exist in version 3.5.5.3, xls files with a size of 40KB stores increased to 1.3MB.

Revision history for this message

In freedesktop.org Bugzilla #51200, Andis (andis-lazdins) wrote on 2012-07-14:

#10

Yes, I found the same that some xls files considerably increase in size after saving with 3.5.5.3, however, not the same published here before, but also some kind of EC time sheets and relevant documents

Revision history for this message

In freedesktop.org Bugzilla #51200, Libreoffice-z (libreoffice-z) wrote on 2012-07-16:

#11

I think new Version is wrong
<http://wiki.documentfoundation.org/BugReport_Details#Version>

@Markus:
I am pretty sure that Bug 52141 is a DUP what confirms that the problem still exists in 3.5.5.3

Revision history for this message

In freedesktop.org Bugzilla #51200, Markus Mohrhard (moggi) wrote on 2012-07-16:

#12

*** This bug has been marked as a duplicate of bug 51878 ***

Revision history for this message

In freedesktop.org Bugzilla #51878, Markus Mohrhard (moggi) wrote on 2012-07-16:

#18

*** Bug 51200 has been marked as a duplicate of this bug. ***

Revision history for this message

In freedesktop.org Bugzilla #51200, Markus Mohrhard (moggi) wrote on 2012-07-16:

#13

So no this was not a duplicate but another problem with our xls export filter. This time not introduced by me!

Same problem exists for xlsx export and is already tracked by another bug report.

Revision history for this message

In freedesktop.org Bugzilla #51878, Markus Mohrhard (moggi) wrote on 2012-07-16:

#19

*** Bug 52141 has been marked as a duplicate of this bug. ***

Revision history for this message

In freedesktop.org Bugzilla #51878, Markus Mohrhard (moggi) wrote on 2012-07-17:

#20

Should be fixed for 3.6.0 RC2 by reverting the problematic commit.

@Noel Could you please have a look at this problem? We did not yet revert it for 3-5

Revision history for this message

In freedesktop.org Bugzilla #51878, Vitriol-vitriol (vitriol-vitriol) wrote on 2012-07-17:

#21

*** Bug 52211 has been marked as a duplicate of this bug. ***

Revision history for this message

In freedesktop.org Bugzilla #51878, Wugs (wugs) wrote on 2012-07-18:

#22

NEW due to all the duplicates and Markus Mohrhard's comments.

Revision history for this message

In freedesktop.org Bugzilla #51200, Zenonbybloch (zenonbybloch) wrote on 2012-07-18:

#14

http://cgit.freedesktop.org/libreoffice/core/commit/?h=libreoffice-3-6-0&id=de9c6a7829b08968491c8b57b5bd4f182e5e873e

Revision history for this message

In freedesktop.org Bugzilla #51878, Zenonbybloch (zenonbybloch) wrote on 2012-07-18:

#23

http://cgit.freedesktop.org/libreoffice/core/commit/?h=libreoffice-3-6-0&id=de9c6a7829b08968491c8b57b5bd4f182e5e873e

Revision history for this message

In freedesktop.org Bugzilla #51878, Bg-g (bg-g) wrote on 2012-07-24:

#24

I am getting huge XLS files when saving spreadsheets as XLS with spreadsheets
that previously were similar size or slightly smaller in XLS form than in ODS
form.
Now the XLS file is well over 50 times bigger than the ODS file!!!
This is with V 3.5.5.3 on WINDOWS.

Revision history for this message

In freedesktop.org Bugzilla #51200, Bg-g (bg-g) wrote on 2012-07-24:

#15

Revision history for this message

In freedesktop.org Bugzilla #51878, Nopower (nopower) wrote on 2012-07-24:

#25

(In reply to comment #4)
> Should be fixed for 3.6.0 RC2 by reverting the problematic commit.
>
> @Noel Could you please have a look at this problem? We did not yet revert it
> for 3-5

bah, just back from vacation will start looking :-/

Revision history for this message

In freedesktop.org Bugzilla #51878, Frob-c (frob-c) wrote on 2012-07-26:

#26

Created attachment 64725
one more test file

Revision history for this message

In freedesktop.org Bugzilla #51878, Nopower (nopower) wrote on 2012-08-09:

#27

fixed as a result of new patches for bug #50304

Revision history for this message

Nobuto Murata (nobuto) wrote on 2013-06-26:

Dependencies.txt Edit (3.6 KiB, text/plain; charset="utf-8")

Revision history for this message

Nobuto Murata (nobuto) wrote on 2013-06-26:

to fix it, two commits need to be cherry-picked:
http://cgit.freedesktop.org/libreoffice/core/commit/?id=de9c6a7829b08968491c8b57b5bd4f182e5e873e
http://cgit.freedesktop.org/libreoffice/core/commit/?id=4ed0eaca6c14aeb652cbebe18081cc9e7e1444ac

Bug Watch Updater (bug-watch-updater) on 2013-06-26

Changed in df-libreoffice:
importance:	Unknown → Medium
status:	Unknown → Invalid

Nobuto Murata (nobuto) on 2013-06-26

Changed in df-libreoffice:
importance:	Medium → Unknown
status:	Invalid → Unknown

Bug Watch Updater (bug-watch-updater) on 2013-06-26

Changed in df-libreoffice:
importance:	Unknown → Medium
status:	Unknown → Fix Released

Nobuto Murata (nobuto) on 2013-06-26

description:

updated

Revision history for this message

In freedesktop.org Bugzilla #51878, Björn Michaelsen (bjoern-michaelsen) wrote on 2013-06-26:

#33

Adding downstream bug, also setting version to 3.5.5.2 as per downstream bug description as a regression between 3.5.4 and 3.5.5.

Brian Murray (brian-murray) on 2013-06-26

Changed in libreoffice (Ubuntu):
importance:	Undecided → Medium

Revision history for this message

Nobuto Murata (nobuto) wrote on 2013-06-27:

#28

sru-debdiff-for-precise-3.5.7-0ubuntu4.debdiff Edit (7.6 KiB, text/plain)

Björn Michaelsen,

Could you include the attached debdiff into the next SRU for precise? Thanks.
http://anonscm.debian.org/gitweb/?p=pkg-openoffice/libreoffice.git;a=shortlog;h=refs/heads/ubuntu-precise-3.5

Revision history for this message

Ubuntu Foundations Team Bug Bot (crichton) wrote on 2013-06-27:

#29

The attachment "sru-debdiff-for-precise-3.5.7-0ubuntu4.debdiff" seems to be a debdiff. The ubuntu-sponsors team has been subscribed to the bug report so that they can review and hopefully sponsor the debdiff. If the attachment isn't a patch, please remove the "patch" flag from the attachment, remove the "patch" tag, and if you are member of the ~ubuntu-sponsors, unsubscribe the team.

[This is an automated message performed by a Launchpad user owned by ~brian-murray, for any issue please contact him.]

tags:

added: patch

Björn Michaelsen (bjoern-michaelsen) on 2013-06-27

Changed in libreoffice (Ubuntu Precise):
assignee:	nobody → Björn Michaelsen (bjoern-michaelsen)
importance:	Undecided → Medium
Changed in libreoffice (Ubuntu):
status:	New → Fix Released

Revision history for this message

Björn Michaelsen (bjoern-michaelsen) wrote on 2013-06-27:

#30

Already fixed in later releases, requested nomination for precise. Doing a ppa build first, maybe considering an SRU later for this.

Revision history for this message

Björn Michaelsen (bjoern-michaelsen) wrote on 2013-06-27:

#31

testbuilding at: https://launchpad.net/~bjoern-michaelsen/+archive/libreoffice-quantaltest-20120601/+sourcepub/3332399/+listing-archive-extra

Changed in libreoffice (Ubuntu Precise):
status:	New → In Progress

Revision history for this message

Björn Michaelsen (bjoern-michaelsen) wrote on 2013-06-28:

#32

Fix commited as:
http://anonscm.debian.org/gitweb/?p=pkg-openoffice/libreoffice.git;a=commit;h=3d70add0dc9a217cb1f0bac63e39566978eedbc2
a build is at:
https://launchpad.net/~libreoffice/+archive/libreoffice-3-5/+packages?field.name_filter=&field.status_filter=published&field.series_filter=precise

if there is no trouble with it, it will it should be SRUed a 1-2 weeks of testing in the PPA.

Changed in libreoffice (Ubuntu Precise):
status:	In Progress → Fix Committed

Revision history for this message

penalvch (penalvch) wrote on 2013-06-29:

#34

example.xls Edit (32.0 KiB, application/vnd.ms-excel)

Upstream attachment noted in Bug Description to demonstrate the problem https://bugs.freedesktop.org/show_bug.cgi?id=50304 .

Revision history for this message

Dimitri John Ledkov (xnox) wrote on 2013-07-09:

#35

For series tasks, ubuntu-sru team is using status to specifically track packages that have been published in -proposed and waiting validation. This bug has not yet bee uploaded into precise-proposed, as far as I can tell. Thus resetting back to "In Progress".

How did the PPA testing go? Is this ready for upload into precise-proposed?

Changed in libreoffice (Ubuntu Precise):
status:	Fix Committed → In Progress

Revision history for this message

Nobuto Murata (nobuto) wrote on 2013-07-24:

#36

Sorry for late reply.

The package in PPA looks good and works fine.

Now I'm looking at another bugs fixed in later versions to see if backportable in this time SRU.
https://bugs.freedesktop.org/show_bug.cgi?id=42899
https://bugs.freedesktop.org/show_bug.cgi?id=62977
# Those affect users in the company I'm working for.

Revision history for this message

Björn Michaelsen (bjoern-michaelsen) wrote on 2013-07-30:

#37

I'd like to SRU bug #628105, bug #1176923 and bug #1194740 with this build:

https://launchpad.net/~libreoffice/+archive/libreoffice-3-5/+sourcepub/3333599/+listing-archive-extra

Its currently pending feedback on bug #1176923.

Revision history for this message

Martin Pitt (pitti) wrote on 2013-08-21:

#38

Unsubscribing sponsors. Bjoern is handling this already, and nobody else ought to upload just this patch without coordinating with Bjoern anyway. Thanks!

Revision history for this message

Amr Ibrahim (amribrahim1987) wrote on 2014-01-08:

#39

What is the current situation of this bug? I'm still having this issue when saving xlsx files in LibreOffice Calc 3.5.7.2.

Is this bug for xls files only? Do I have to file another bug for xlsx files originally created with Excel 2010?

penalvch (penalvch) on 2014-01-08

description:

updated

Revision history for this message

Björn Michaelsen (bjoern-michaelsen) wrote on 2014-01-13:

#40

This patch was not included in the ubuntu5 update for precise as per:

http://anonscm.debian.org/gitweb/?p=pkg-openoffice/libreoffice.git;a=commit;h=95c677321ac0a7b895bb5d6d3d109d2a561f7dd1

should there be another serious issue causing us to prepare another update, I will consider reinvestigating if this issue will be fixed along.

Revision history for this message

Björn Michaelsen (bjoern-michaelsen) wrote on 2014-03-13:

#41

The fix was in 3.5.7 upstream already -- so closing.

Changed in libreoffice (Ubuntu Precise):
status:	In Progress → Fix Released

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Patches

sru-debdiff-for-precise-3.5.7-0ubuntu4.debdiff Edit

Add patch

Bug attachments

Add attachment

Remote bug watches

freedesktop-bugs #42899
[RESOLVED FIXED] Edit
freedesktop-bugs #50304
[RESOLVED FIXED] Edit
freedesktop-bugs #51200
[RESOLVED DUPLICATE] Edit
freedesktop-bugs #51878
[RESOLVED FIXED] Edit
freedesktop-bugs #62977
[RESOLVED FIXED] Edit

Bug watches keep track of this bug in other bug trackers.

Ubuntulibreoffice package

[precise] Saving xls files originally created in Excel 2003 causes considerable increase of file size

Bug Description

Other bug subscribers

Patches

Bug attachments

Remote bug watches

Ubuntu
libreoffice package