See the smiley face next to your user name at the top of the mail page? Click it – then click Sign out of chat. (If you never signed in, the face is gray and sleeping...meaning you're already signed out/disabled.)

Since Yahoo! Mail remembers your settings from session to session, you'll be signed out of chat until you change it.