You can swipe to delete messages in the iPhone's Mail app, but you'll need to enable this option in Settings.
The easiest way to retrieve deleted emails from Yahoo is by quickly going to the Trash folder and undeleting them.