Adobe’s first big Apollo app is an Internet video application codenamed Philo. The pervasiveness of Flash Player created multi-billion dollar Internet video startups powered by the Flash video format. The Philo team hopes to expand the display size and quality of distributed videos and get publishers encoding using the latest Flash video encoders. Publishers can brand the entire video player, delivering MTV content in what looks like a MTV video player, or a Rocketboom-themed player…

Great!! thats just what I want – an MTV branded video player to play MTV videos and a Rocketboom branded video player to play Rocketboom videos. Awesome!

This is not the future of the web people, and it certainly isn’t the future of the desktop. Please try to resist.

Discoverability

Novice users are surprised when you tell them you can right click things to get extra options.

Added complexity

After discovering that their interface to the computer has another variable, they can become confused as to which button they should use in which situation.

Too many options

Because GUIs usually have a lot of containment metaphors, right-clicking on a point means you could be directing your attention to any of several nested entities. As a result, context menus don’t have enough context and tend to be very long and hence difficult to find things in.

Discoverable, Entity Specific, Left-Click Context Menus

There is an alternative

• When the user makes some gesture towards an object such as hovering over it, a discreet target is displayed close outside the border of the object.
• If the user makes a gesture towards the target, hovering or clicking, it expands to show possible contextual actions for that object.
• Otherwise, if the user moves in a different direction, the target disappears.

IMHO, this goes some way to solving the problems above. Newbies can discover contextual functinoality easily. They don’t need to worry about an extra mouse button. And the menus can be entity-specific, so the functionality can be simplified. Plus, this interface is an evolution: it can be complimentary to the standard right-click menus.

Issues

Small Entities

Sometimes the user may want to direct attention to a small part of the interface, for example a character in a text editor or a pixel in a graphics package. These are valid conceptual entities and as such should have associated actions and options. However, it seems impossible to display a context menu target for every mouse over of such entities – The smaller the entity, the harder it is to avoid the menu target.

Overlapping Entities

Sometimes different conceptual entities take up exactly the same screen real estate. This increases the complexity of the contextual menu, but no more than that of a right-click menu.

Microsoft Office 2007

This pattern has popped up as one of the changes in the new MS Office interface overhaul. Here’s what happens when you select a piece of text. Look closely, there’s a hint of a contextual toolbar there:

As you move your mouse towards the faint target it gets solid and you can directly change the properties of the text:

If you move your mouse in the opposite direction it disappears and never comes back.

It seems the Office team have only used this on text selections and only for text formatting properties so far. It works in Excel and Power point as well. If you want to try out the new interface for yourself, Microsoft have set up vanilla installs that you can interact with through a website without installing anything. You have to have Internet Explorer on Windows, and be willing to install some ActiveX remote desktop plugin.

Elsewhere

Here’s another example from Flickr. Right-click menus are even less discoverable on the web, since not even experienced users expect them. Hence, Flickr does this when you mouse over a person:

Seen any other examples?

Having said that, I did keep trying to use it. If it worked properly I would find it pretty useful. But don’t you feel this should and will be baked into the OS?

On the downside, the iTunes version doesn’t seem as good at getting album art automatically, and incidently, ignored my almost complete CoverFlow artwork database when trying to find the right images. The wonderful interface for adding album art manually has been lost in the transfer too. In CoverFlow there was a handy context menu item for doing a search on Google Images or Amazon for the artist/album name. And you could copy and paste any image you found directly onto the album. With iTunes there’s a whole rigmarole of selecting all the songs on the album, opening a dialog, and then pasting.

Oh, and yes that does say Chistina Millian, and no I don’t know how that got there.