Unfortunately the public site editor doesn't work very well and gets worse the more you edit. You can use the "float" option for images to position them and some people arrange everything in tables to control the layout better. You can also add your own style code to enforce a layout.
You'll find some tips on how to do that by selecting "Customize your Office 365 public web site" from this page.