All the call setup and call termination information goes through the servers.
Yahoo! Messenger will attempt to send voice data through the peer-to-peer method. If Yahoo! Messenger can't set up a peer-to-peer connection, it will route the voice data through Yahoo!'s relay servers.