Steps to reproduce:

1. Go to All/All/All.
2. Search for a particular song, and play it (don't erase anything
from the search field).
3. Decide you want to listen to more of the same artist by clicking on
the artist in the artist browser. 
4. Erase everything from the search field to get the full album list.
5. Only songs from the same album as the song you chose to play
appears in the album browser. (even when you start to play songs from
another album by the same artist)

You need to manually choose some other artist and/or genre to get the
full list.

This bug is probably related: (or should I file it seperately?)

Select artist from browser, use the search field.
Go to All/All/All, rb continues to search and lists songs found in the
entire library. The album list is updated with the list on album that
match the search. 
Erase everything from the search field, rb refuses to update the album
list. Again this must be done manually.

Using Rhythmbox 0.6.0