Created attachment 115918 [details]
sample mailbox file. Just save as, and copy under ./evolution/mail/local.

example mailbox that does not show all emails. BTW -- due to a problem with my X server and (it seems) GTK applications I was forced to go KDE for a while, until I figured out what was going on. I set up Kmail, and imported my few local mailboxes into Kmail -- and *ALL* emails are then shown for the example mailbox.

Now, back to Gnome, I cannot see all emails.

I'm the original submitter of this bug on Launchpad. This is my original bug description:

"Since yesterday's update (2008-07-09) a few but not all new emails are *not* displayed in Evolution. When I realized there were missing emails I looked into the mailbox file of my Inbox ("tail -n 1000 .evolution/mail/local/Inbox") and found that the emails were downloaded but not displayed!"

Because of the severity of this bug I decided to switch to Thunderbird. Now I know: This email client is not barely as mature as Evolution. Thus I'd love to switch back to Evolution, but need to be sure that this major bug is fixed.

Could anybody please check if they can read this attached mbox file?
http://bugzilla.gnome.org/attachment.cgi?id=115918
It contains *six* messages, but Evolution only displays *four* of them! So unless all emails are listed in Evolution, I can't trust the application that it displays all of my messages.

Thanks a lot for your support!

I can confirm that the above test mbox shows me only 4 messages in Evolution but the full 6 in Thunderbird. I have had concerns about missing e-mails before and after migrating to TB, I noticed older e-mails that I had never read before. 

This should be concidered as a MAJOR bug! Please test/confirm...

So please take the little time it takes to confirm this: Just right-click the link above and hit 'Save link as...', browse to your ~/.evolution/mail/local/ folder and give the file a name that does not exist yet (e.g. 'Test'). Do this a second time but now save to ~/.mozilla-thunderbird/XXXX.default/Mail/Local Folders/ and check the difference in Evolution and TB.

I am switching to Thunderbird until this is resolved. I cannot afford any more e-mails gone missing :(

ADDITIONAL INFO to comment #3:
Evolution 2.22.3.1
(X)Ubuntu 8.04 AMD64

Took a quick look at the mbox file and I didn't see anything obvious that would cause Evolution to miss messages (e.g. like messages being butted up against each other or unclosed multipart boundaries).

My guess is that there's a bug in read-boundary handling (e.g. something which would cause a state change falls on a 4096 byte boundary) in the parser somewhere.

I'll leave it up to current maintainers to dig into this more...

In my local mail folder message 0, 1, 4 and show up in a regular box (I imported them to Drafts). 2 and 3 show up in Spam. Might explain something. Running 2.22.3.

s/Spam/Junk/

Ok, editing all X-Evolution headers for this (grep -n output):
    42:X-Evolution: 000007ab-0010
    121:X-Evolution: 000007ad-0010
    175:X-Evolution: 000007af-0090
    228:X-Evolution: 000007b1-0090
    309:X-Evolution: 000007b3-0010
    381:X-Evolution: 000007b5-0000
to this:
    42:X-Evolution: 000007ab-0010
    121:X-Evolution: 000007ad-0010
    175:X-Evolution: 000007af-0010
    228:X-Evolution: 000007b1-0010
    309:X-Evolution: 000007b3-0010
    381:X-Evolution: 000007b5-0000
makes the problem disappear.

I guess "X-Evolution | 0x80" is some sort of Junk flag.

This suggests the problem actually is: some spamfilter marked messages 2 and 3 as spam while they weren't. I guess we need to know what the setup was that received these messages. NEEDINFO? (NOTABUG seems a bit premature ...)

(In reply to comment #8)
> I guess "X-Evolution | 0x80" is some sort of Junk flag.

See: ./camel/camel-folder-summary.h:75:	CAMEL_MESSAGE_JUNK = 1<<7,

thanks for the digging, big sigh of relief from me ;-)

Thanks for looking into this issue! What information is necessary about my Evolution or spam filter/configuration?

Matthias, very first question: do you see the missing emails in your Junk folder?

Now: OK, so they are marked as Junk. So why is it I cannot see them in the Junk folder? In my case, I simply added the attachment under my ~/.evolution/mail/local. If a message is marked spam, it should be shown in the Junk folder -- even if I just added in a new mbox.

(BTW, I can only *copy* then mailbox file in under ~/.evolution/mail/local -- the File/Import does not seem to be working on trunk)

And then, this begs another question: http://bugzilla.gnome.org/show_bug.cgi?id=272027 has been opened for quite a long time. This would allow for *new* automatically processed junk mail to be set unread, and would allow for easy identification of something like this.

Right now, I agree it is too early to mark it NOTABUG.

Correction & retraction:

After I re-enabled search folders, and re-added the mbox in the attachment, now the two emails marked as Junk are shown in the Junk folder.

It is, still, interesting, that emails that I forcefully marked as Junk *were* shown in the Junk folder (but, it seems, not the two in question).

I am sort of confused, right now.

Yes, I see the 'missing' emails in the junk folder - copied several times but marked as 'read', so I didn't discover them until this moment. I have to say that I never used the spam filter options of Evolution as it didn't seem to work (despite of installing SpamAssassin). But obviously it did this time...

(In reply to comment #13)
> I am sort of confused, right now.

In comment #1 you state that you copied this mbox manually to you local evolution folder. (Don't know under which name). Evolution (re)created the folder for that mbox. (Same effect as deleting a folders metadata, I guess.) It knows it shouldn't include messages marked as junk. Maybe this doesn't trigger the code to add those files in the virtual Junk folder (might be by conscious design, haven't checked).

If you import an mbox to a folder that folder is updated with new messages but apparently messages already flagged as junk are added to the virtual Junk folder (again, this might be by conscious design, haven't checked) and hidden in the regular folder.

We might squeeze a bug out of that ("Ignore X-Evolution headers for imported messages" or whatever). Not sure what its fate will be. The trouble you ran into with copying mailboxes by hand is probably just WONTFIX.

This bug may be older than evolution 2.22. I am using evolution 2.12.0 on opensuse 10.3, and am getting the same problem. 

After clearing out the .evolution/exchange/"account" folder, I got a full list of messages back. For some reason however, they are no longer in chronological order.

(In reply to comment #16)
> This bug may be older than evolution 2.22. I am using evolution 2.12.0 on
> opensuse 10.3, and am getting the same problem. 
> 
> After clearing out the .evolution/exchange/"account" folder, I got a full list
> of messages back. For some reason however, they are no longer in chronological
> order.

This bug concerns messages received for a POP account and not via Exchange. Moreover it is about messages marked as Junk. You do not mention problems with Junk.

Please check if your issue is covered in an Exchange specific bug.

Is this still a problem in 3.4.3 or 3.2.3?

Hi C, 
if you have time, could you please check again whether this issue still happens in Evolution 3.8.5 or 3.6.4 and update this report by adding a comment and changing the "Version" field and provide information about your distribution? Thanks a lot.

Closing this bug report as no further information has been provided. Please feel free to reopen this bug if you can provide the information asked for.
Thanks!