Evolution looses some mails on the way from the inbox to the screen

Bug #44828 reported by Blue
16
Affects Status Importance Assigned to Milestone
Evolution
Invalid
Undecided
Unassigned
evolution (Ubuntu)
Fix Released
Medium
Unassigned

Bug Description

Binary package hint: evolution

After upgrading from breezy to dapper, and after a week or to with dapper evolution started to forget about some mails that ARE received. For example, in some folders the mail arrives from the pop3 server (the mail can be checked for example in
/.evolution/mail/local/Inbox.sbd/subfloder.sbd/FOLDER but however are not displayed on the screen.
It is not an isolated problem, now only a few percent of the new emails are actually displayed.
Deleting summary/index files (forcing evolution to recreate them) does not help.
I have to mention that there are a lot of mails stored in evolution, and the sheer total number of emails could be the problem (or a catalyst ) for this. However I do not think the number of emails is the only reason, because first a few new emails still get displayed and second this behaviour seems to have started after an upgrade that also updated evolution.
In order to prove this situation I can provide a few screenshots, and by request the files corresponding to a folder that is not displayed properly.

Revision history for this message
Blue (vali-dragnuta) wrote : Evolution downloading lots of mails

Evolution downloading lots of mails

Revision history for this message
Blue (vali-dragnuta) wrote : Folder with missing messages.

The thread "WEBDAV" has a few replies, but evolution can't find them.

Revision history for this message
Blue (vali-dragnuta) wrote : One of the missing messages

A missing message from the "WEBDAV" thread can be identified in the folder's mbox.

Revision history for this message
Blue (vali-dragnuta) wrote :

...and at a first glance it seems that the correctly displayed message has charset=ISO-8859-1 while the invisible message has charset=ISO-8859-2

Revision history for this message
Blue (vali-dragnuta) wrote :

As I said, I can provide the files of a problematic folder, but as we're talking about 50 megs of data and as the folder contains some sensitive data (email addresses for example) I expect to be contacted personally in order to provide these files.

Revision history for this message
Sebastien Bacher (seb128) wrote :

Are the mails on the disk to that directory? Could you just attach an example of mails listed by the directory and not by evolution? Does it work using the same directory with an another mail software?

Revision history for this message
Blue (vali-dragnuta) wrote :

The mail are on the disk in that directory. In my screenshots you can see :
1. Evolution shows only one mail in the "WEBDAV" - the initial mail in the thread that also has some replies.
2. I viewed the mbox file with mcview and i focused exactly on one of the replies in that thread, so it can be seen that the mail exists but evolution does not display it. It could be a charset problem, but I'm not sure. Please tell me if you need other details.

Thank you.

Revision history for this message
Blue (vali-dragnuta) wrote :

This is output from evolution when launched from a terminal :
(evolution-2.6:6287): e-data-server-WARNING **: Could not open converter for 'cp-1252' to 'UTF-8' charset

(evolution-2.6:6287): e-data-server-WARNING **: Could not open converter for 'cp-1252' to 'UTF-8' charset)
(evolution-2.6:6287): e-data-server-WARNING **: Could not open converter for 'charset=iso-8859-1' to 'UTF-8' charset

---Lot's of message like the above ones---

(evolution-2.6:6287): e-data-server-WARNING **: Could not open converter for 'charset=us-ascii' to 'UTF-8' charset
(evolution-2.6:6287): camel-WARNING **: Could not find key entry for word 'текстильное': Invalid argument
(the above was a spam)
(evolution-2.6:6287): camel-local-provider-WARNING **: Didn't get the next message where I expected (54973265) got 4882779 instead
(evolution-2.6:6287): camel-local-provider-WARNING **: Didn't get the next message where I expected (54973265) got 4882779 instead

In the GUI these errors appeared (see the following attachment).There is no other evo instance started.

Revision history for this message
Blue (vali-dragnuta) wrote : New screenshot, new errors

New screenshot, new errors - see the previous comment for what evo says in the terminal.On request I could send the full output.

Revision history for this message
Carl van Tonder (carlvantonder) wrote :

I can confirm this bug on a somewhat less-than-fresh evolution install. There are no suspicious terminal messages (beyond some spamassassin message) and again, removing the index does nowt. Ideas?

Revision history for this message
Sebastien Bacher (seb128) wrote :

do you still have that issue?

Revision history for this message
Blue (vali-dragnuta) wrote :

I suppose the bug is still there. Meanwhile I switched to IMAP to overcome evo's problem by keeping all messages on the mail server.

Revision history for this message
Daniel Holbach (dholbach) wrote :

Anybody else who can confirm the issue?

Changed in evolution:
status: Unconfirmed → Needs Info
Revision history for this message
Blue (vali-dragnuta) wrote :

Probabbly it's an obscure bug , hard to encounter. However, please tell me what else could I send to you so that you can confirm the problem yourself.

Thank you,

Revision history for this message
Daniel Holbach (dholbach) wrote :

You could try to get a debug log using CAMEL_DEBUG=all evolution >& evo.log and attach that here?

Revision history for this message
Christoffer Kjølbæk (ostehamster) wrote :

Hi,

My evolution started to have this behaviour. This morning, I downloaded about 25 mails, but only 4 or so i showned in Evolution, but they are in different Inbox files in the Evolution directory.

I am wondering how long this has been going on, and how many mails I haven't seen :/

Is there some way, to force evolution to index all the mails again?

Best regards
Christoffer

Revision history for this message
Blue (vali-dragnuta) wrote :

Christoffer, could you make the test that Daniel proposed ? (The previous post). After I encountered the problem I switched to imap and it would be quite hard for me to switch back to pop3 and reproduce the problem with CAMEL_DEBUG=all.

Revision history for this message
Christoffer Kjølbæk (ostehamster) wrote :

Is there any specific data you are interesting in? There is a good load of sensitive info in the .log file, so would prefer only to paste some of it.

And actually, I have found a kind of work around. I opened the file ~/.evolution/mail/local/Inbox, and removed ALL lines that started with "X-Evolution", and that worked.

So maybe the mail file and the index file gets out of sync? Although I already tried to remove all .ev-summary without any luck.

Revision history for this message
Blue (vali-dragnuta) wrote :

If there is confidential data in the log file, try to find&replace the sensible strings (emails,servers... ) with something else.
Obviously there is no easy way to tell what could be relevant and what not in the context of this bug. Maybe a developer can help here.

Revision history for this message
Christoffer Kjølbæk (ostehamster) wrote :

I will make the log file later today.

But it seems that the "work around" I mentioned in the previous post worked. I am checking all my emails account through webmail, before I hit "Send and receive" in evolution, and so fare I haven't lost any mail.

Revision history for this message
Christoffer Kjølbæk (ostehamster) wrote :

Sorry for my late response.

My computer has been down, and I decided to reinstall it with Ubuntu Feisty Fawn which a comming with Evolution 2.10.1

In this version, I can't reconstructed the bug, so maybe it is already solved?

Revision history for this message
Daniel Holbach (dholbach) wrote :

Thanks for following up. Closing the bug.

Changed in evolution:
status: Needs Info → Fix Released
status: Unconfirmed → Rejected
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.