Model-driven development of interactive and integrated 2D and 3D user interfaces using MML

While there is a lot of research done in the area of 2D or 3D user interfaces (UIs) construction, comparatively little is known about systematic approaches to designing and developing integrated 2D/3D UIs and applications. The previously developed multimedia modeling language (MML) provides a top down approach for a model driven development of 2D/3D UIs and applications. The MML structure model and media components provide support for including X3D based content and automatic generation of application skeletons. We use a work instruction manual for a woodchipper as an example to illustrate how to apply MML. We discuss the ramifications of this approach and opportunities for some improvements.