Yes, PHP 5.0 and MySQL 5.0 are both supported and are listed here:
http://www.ultimahosts.net/products/standardplans/