ideally, users could bring their own tools for given job - for example editing vector image inside of a text document would open inline "vector editing tool" - instead of current workflow of editing in another app, and then exporting
this is related to idea of transclusions, but not only for pieces of documents inside of other documents, but for a bigger problem of editing mixed media
this also feels related to prior art of interactive notebooks, where a single document could have blocks of code executed in different kernels
general solution to this problem would be amazing
Same Data Multiple View should tie into this - maybe editing tools are another view on top of the same data?
The idea in the UI is that it will sprout in a frame around the object when you go into it
Look carefully at those clips, and notice that even when users are interacting with an overt "computer," rarely are they focusing on "applications" (i.e., "programs"). Watch those clips again, and notice which "things" the users are seeing and manipulating. Those things most often are objects in the users' domains of work or play, rather than the tools (computer applications) that the users use to deal with those domain objects. This is most apparent in direct manipulation gestural interfaces. The users are grabbing, rotating, and flinging people, diagrams, buildings, and spacecraft.
Similarly, users simply flip views of the same manifestation of an object, from graphical to alphanumeric to pictorial to audio, rather than searching again for that same object in each of several different applications, each devoted to only one such type of view. The heroine is looking at a live satellite image of the building, then flips that exact same portion of the screen to show a schematic view of the building, as if putting on x-ray glasses. She does not fire up the separate "Schematic Viewer" application and, once there, hunt down that building. She does not even drag that building's image from the "Satellite Viewer" application to the "Schematic Viewer" application.
