No, that's not entirely right.. sshd can indeed be listening on both interfaces and clients should be able to connect over both, check your configuration.
You can use pf's
route-to to set up outbound loadbalancing for clients, in a round-robin fashion.
http://www.openbsd.org/faq/pf/pools.html#outgoing