That's the whole point. It's not convenient to go to so I don't use it for daily expenses, just savings and low rate loans.
You can always use them online though, which might mean no saving for some people. Can't see having multiple banks and credit unions. There's no benefit if you have one good CU and one good bank.