Lots of RTEs allow you to add images and float them, but not many allow for simple captions to be wrapped around the images…
This script in conjunction with jQuery allows just that… Very simple and fairly unobtrusive.
If you wanted to add captions to all images (from their longdesc, title or alt attributes) within <div class=”content”/> you could do:
$('div.content').addCaptions();
Which produces something like this:

No styling is carried out by the script itself, so you’ll have to add in some extra classes, but in the zip file should be everything you need to get started (including jQuery 1.3.2 minified).
Edit: Added to the work blog too.
Update: I have updated the script, see this post.