If you literally want a button, the simplest way is to add a block, and on that block include your log out button (text or image) with a link around it linking to /logout.

Set the block to only be visible to the role Authenticated users.