I have been working with Sheila who works on Office Online to get the OneNote templates up on Office Online. You can see them here:
These are the same templates that you would see in OneNote when you chose File–>New–>Notebook. But now you can download them off the web or see them in OneNote, either way. Additionally you can create your own notebook templates, just save the file as a .onepkg file and that is your notebook template.
If you all have questions please let me know!