Digital Media Technologies

August 3rd, 2010

DMT is on again for Spring 2010 – I’m lecturing with Oanh. Hello everyone.

Email and Trust

June 10th, 2010

DISCLAIMER: This email message and any accompanying attachments may contain confidential information. If you are not the intended recipient, do not read, use, disseminate, distribute or copy this message or attachments.

Translation: We don’t trust you.

If you have received this message in error, please notify the sender immediately and delete this message.

Translation: We don’t trust email.

Any views expressed in this message are those of the individual sender, except where the sender expressly, and with authority, states them to be the views of the University of Technology Sydney.

Translation: We don’t trust our staff.

Before opening any attachments, please check them for viruses and defects.

Translation: You should not trust this message.

Gerhard Fischer at CCS

June 3rd, 2010

To our great delight Professor Gerhard Fischer is visiting my research group, the Creativity and Cognition Studios this afternoon, at the invitation of our own Professor Ernest Edmonds.

Earlier this morning Prof. Fischer delivered this HAIL lecture on Meta-Design and Social Creativity at the CSIRO. And as social creativity is a central research concern for many of us here, we’re quite excited to have him here.

Personally I’m hoping to talk about mixed reality and tabletop systems as opposed to immersive virtual environments for collaborative creativity at a distance. Or the role of Collaborative Place. Or whatever comes up ^_^

What I’m working on

April 13th, 2010
processing sketch with webcam, 3d, drawing

processing sketch with webcam, 3d, drawing

Location and the iPad

April 7th, 2010

Location is not Place, but the two concepts do intervolve. Or perhaps (when I’m feeling well-disposed to the world) they intertwingle.

So I’m interested in location, and for this reason will be buying the wifi+3G iPad, which has a comprehensive suite of location-awareness technologies, rather than the wifi iPad, which is also location-aware but less comprehensively so.

I keep seeing absurd fallacies being promulgated about the iPad and Assisted GPS. I think “promulgated” is a word that is now entirely reserved for absurd fallacies. Do you think anyone is out there promulgating enlightenment? If they are, they’re not posting to the Wired Gadget Lab weblog comment threads, anyway.

So here for your edification is the truth about A-GPS vs. GPS vs. wi-fi triangulation.

Note: this is dull, don’t bother reading it. I just had to get this rant down to stop me boring people with it in person.
Read the rest of this entry »

More prototyping

February 26th, 2010

Not from me this time, from the excellent folks at Omnigroup. Beautiful.

Prototyping

February 26th, 2010

Or is that sketching?

Imaginary tablets

January 26th, 2010
Imaginary tablets
[posting this now as text-only; will upload photos of my prototypes shortly]
For those of us interested in how humans interact with our machines, how socio-technical systems are made and how they make us, this is a precious moment. Tomorrow the probability waveforms collapse, Schroedinger’s cat will be let out of the bag; Apple will reveal the form of their long-rumoured slate. In the realisation of a new kind of computing device many decisions are made. Not many companies are equipped to make and execute those decisions well. At the moment I can think of two: Apple and Palm. And as Palm is otherwise engaged, it falls to Apple to bring us the first fully-realised such device.
That’s why today, the moment before the Apple tablet is unveiled, is precious. From tomorrow it will be impossible to imagine a slate without reference to Apple’s design, just as now all smartphones are compared to the iPhone.
The iPhone is Alan Kay’s Dynabook in the deck-of-cards form factor. Now Apple are ready to make the full-sized version; the paperback form factor. Kay put it at 8 by 5 inches – 10 inches diagonally. The size of a small paperback book, or a sheet of A4 folded in half (which is to say, A5). We know that this form factor is important. But it’s been hard to stop thinking of computers as anything other than television-typewriters.
The TV-typewriter form factor has found its epitome in the laptop as we know it: hinged keyboard-and-screen, trackpad and desktop metaphor. Shall I enumerate its faults? Too big and fragile to carry in an ordinary bag, we must instead heft special laptop bags with padded compartments and room for little else. Too energy-hungry for sustained use away from power. A screen that doesn’t work in sunlight. Too heavy to use while carrying. When equipped with processors fast enough to run a modern desktop operating system and 3D graphics, it’s too hot to actually use on a lap. The laptop is wonderfully portable, but not truly mobile.
The A5 dynabook won’t be better for all tasks. However it will afford different activities to those afforded by the laptop, desktop workstation and handheld device, and thereby expand the range of human creativity. That makes it exciting.
However Apple’s version will have its own affordances and constraints. It will be optimised for certain tasks; there’s more than one way to skin a universal computing device. From tomorrow we are in danger of forgetting that.
I’m conducting PhD research into creativity support tools, through a process of building and testing prototypes. Some of the prototypes have been slates, of various shapes and sizes. Form factors made from foamcore, weighted with aluminium; interactivity simulated with my (jailbroken) iPhone. I’ve been carrying them around and imagining how they fit into various scenarios. Here are some things I’ve learnt:
1. Size & Weight, and thus Connectivity
- 7-inch tablets beat 10-inch for portability. You can fit one in a coat pocket or a purse. But they’re small enough that  you can actually lose one. You’ll want a GPS tracker in that thing.
- Say a 10-inch tablet is 500g, splitting the difference of four iPhones or iPods Touch. That’s the weight of a medium-sized book, and much less than a laptop. For example a Macbook Air is 1360 g and a 15” Macbook Pro is 2490 g. That weight is great for portability and reading, but for one-handed interactivity you actually want lighter. The lighter you go, the more you can do and the more likely you are to carry it around. No hard drive. A Flash drive is light enough. For longevity put a memory card slot in the thing; then as memory prices plummet it’ll keep getting more useful. When costing this thing out for engineering, the primary cost you care about isn’t dollars, it’s weight.
- The most effective way to lose weight is to put things outside the tablet.  Files, and also processing. Voice recognition, 3D, video editing: control them from the tablet, but do the processing somewhere else. You should be able to control a desktop workstation from this, and also invisibly use all kinds of services that run on remote servers. This implies full-time connectivity; not just wifi but 3G and whatever comes next. It doesn’t matter how you get the connectivity there: people will still carry phones so tethering is an option.
2. Colour and Form
A black bezel is a terrible idea for e-reading; you want a white margin around a page of text. Ideally the margin is interactive and can hold annotations anyway, so you just want all screen. If there has to be a bezel, make it as seamless as possible (and possibly accepting touch input). If there’s a rim, it should be white or silver.
3. Keyboard & Other Inputs
- A 10-inch tablet can fit a full-size on-screen keyboard in landscape orientation.
- Typing on a full-size keyboard with one hand is a pain. Set it down on a surface and it works. Or turn the slate to portrait, and you have a keyboard that you can use with one hand while you hold the slate with the other.
- If you’re writing long documents, a bluetooth keyboard is fantastic.
- Enable other input devices too. Game controllers, motion sensors, everything. Artists want a stylus for pressure-sensitivity. More inputs multiply possibilities. But ensure that you can use the stock configuration with multitouch alone, because every input is also a dependency.
4. Collaboration
- A slate in a meeting room is nothing like a laptop in a meeting room. A laptop naturally faces the user; a slate naturally goes face-up on the desk. If you flip it up for privacy then it’s obvious that’s what you’re doing. So:
- Slates afford information sharing in meetings. Sketch, pass it around the table. And here we find an implication for design.
Design problem:
In meetings sketching is a common form of expression and communication for creative ideation. When teleconferencing, remote participants are either left out of this sketching process, or it stops.
Opportunity:
Tablets can help, because digital sketches can be transmitted between locations. Draw on a tablet here, have it appear on a tablet there. The remote participants can then add to or annotate the sketch; communication is enhanced and the flow of collaborative ideation is unbroken. Win!
Extension:
People also like to sketch with concrete tools (pencil and paper, arrangements of sticky notes, whiteboards, butcher’s paper etc). Tablets could have a camera or even a full-surface scanner, and thereby capture those analog sketches in digital format. This affords greater sharing with remote participants, review and archiving of materials, and with OCR and metadata, search & retrieval.
5. Capture & annotation
This leads me to an affordance I haven’t fully understood yet: slates afford rich annotation. You need a responsive screen: e-ink won’t do, but a Pixel-Qi transflective or something similar is ideal. But if you have that, then you can capture images, either by drawing or photographing. And then you can start to annotate the images, directly manipulating them on the device. The surface is large enough to work with, and the infinite depth afforded by zoom means there is plenty of room. Every image can be a rabbithole; a portal to an information space without inherent limit. 10 inches in the diagonal, and infinity in the z-axis.
Right. I have more, but it’s unformed. Let’s hope that after 5 AM Sydney time tomorrow I can still think clearly about imaginary tablets as well as the real.

[now updated with prototype images]

For those of us interested in how humans interact with our machines, how socio-technical systems are made and how they make us, this is a precious moment. Tomorrow the probability waveforms collapse, Schroedinger’s cat will be let out of the bag; Apple will reveal the form of their long-rumoured slate. In the realisation of a new kind of computing device many decisions are made. Not many companies are equipped to make and execute those decisions well. At the moment I can think of two: Apple and Palm. And as Palm is otherwise engaged, it falls to Apple to bring us the first fully-realised such device.

That’s why today, the moment before the Apple tablet is unveiled, is precious. From tomorrow it will be impossible to imagine a slate without reference to Apple’s design, just as now all smartphones are compared to the iPhone.

So before it’s too late, here’s what I’ve learned from six months living with iSlate prototypes.

Read the rest of this entry »

Reclaiming Affordances

November 20th, 2009

The next time you are about to use the word “affordance”, please stop and check if the word “cue” would work instead.

Because if it would, then:
1. you are using an obscure technical term for something that already has a perfectly good plain English word, and
2. you are using that technical term incorrectly.

Yes, I know that languages are living entities. None other than the eminent Don Norman, despairing in his attempts to correct the misuse of “affordances”, has cited this as a reason to abandon the term to its abusers. Yes, words can change their meanings. Generally, I celebrate this fact. But not this time. Technical terms are different. People can start calling air “Oxygen”, but that does not mean that scientists should change the periodic table.

Read the rest of this entry »

Creativity and Cognition 2009

October 26th, 2009

In a few hours I’m off to Berkeley for Creativity and Cognition 2009 to participate in the Graduate Symposium. Mihaly Csikszentmihalyi, Ben Shneiderman, Jane Prophet and my advisor Ernest Edmonds will be among the speakers. I’m quite excited about the whole thing… updates to follow, or see my twitter feed in the meantime.