Rhythmbox should remember the Source that is active at shutdown and select it at launch.  Those users who routinely use any source other than the "Library: browser are currently forced to wait for the entire library to load, then switch to the preferred source, then start playback.  

Other information:
Starting on Library every time is making an assumption about the usage of the app.  That's bad mojo.