Welcome to EMC Consulting Blogs Sign in | Join | Help

Wandy's Blog

Breaking down traditional barriers

Isobel has just turned 4 and uses a computer mouse to (attempt to) navigate sites such as CBeebies.  She finds the mouse challenging and frustrating.  At such a young age her motor movement abilities are still developing.  Combine the motor skills required with spatial concepts necessary to effectively use the mouse and it’s easy to understand Bel’s frustration when she tries to click the Charlie and Lola thumbnail but instead finds herself watching Finley the Fire Engine. 

Bel is slowly improving her mouse control but it’s taking time.  While Bel’s thoughts are concentrated on the mastering of the mouse and the precision control required to click the tiny thumbnails or links, her experience of the Cbeebies web site is somewhat reduced.

Interactions such as drag and drop create more frustrations as Bel struggles to keep the pressure on the mouse button.

I thought it would be interesting to see how Isobel finds an interface that she can interact with pretty much as she interacts with everyday objects.  So yesterday Bel came to our Conchango studio so I could see how she handles Microsoft Surface.  I didn’t give her any warning that she was about to become a guinea pig for me to see how she would interact with the tabletop using touch and gesture.  Not a mouse in site.

As Bel stood next to the interactive tabletop I subtly introduced her to the water attract screensaver, being careful not to describe the unit as a computer to see whether the ease of direct digital manipulation would disguise the technology.

Isobel was immediately captivated by the water simulation that creates ripples when touched.  In no time she was hands-on.  There weren’t the usual oohs and aahs as she played with the water but if you remove the technology from this experience then what is so amazing about it?  To me Microsoft Surface is a complex mix of hardware and software, but to a 4 year old the technology is invisible - it’s not much more than a table that she can do some interesting stuff on.


I pointed to one of the access points, Bel reached out and tapped it.   Next, I scrolled through the demo applications.  Instinctively Bel reached out and copied my actions scrolling through the application with surprising ease.  Bel did not display any of the hesitancy she normally displays in digital-situations but much more the confidence of a non-digital situation.

We then spent the next 30 minutes working our way through the photo app, the music app, photo paint, the piano and Identity Mine’s air hockey.

I preloaded the photo application with photos of family & friends and some of Bel’s favourite TV characters. Isobel instinctively started to explore and manipulate the photos.  She found selecting, moving and orientating the photos very intuitive using natural gestures. She took a little guidance to get a handle on photo resizing but by the time she’d played for 15 minutes she had got to grips with it and could shrink and enlarge the photos with relative ease.


 

With the surface piano Bel had no problems playing the usual tuneless racket that she has mastered so well on her grandma’s piano. Air Hockey, a game she isn’t familiar with, required no introduction to as she demonstrated her dad’s competitive streak with a spirited performance against Matt.

Photo paint took a few minutes for Bel to master as her paint strokes caused the canvas to move but soon she got the hang of this as she created her masterpiece.  An amusing observation was how Isobel wiped her painting finger on her trousers each time before she dipped her finger in the virtual paint palette.  This highlights how the direct manipulation and natural gestures of Microsoft Surface can blur the real and virtual world.

 

The experience was certainly memorable for Bel who listed all her friends at nursery that she is going to tell about Microsoft Surface. Isobel found the whole Surface experience fun and easy to use and the touch and natural gestures overcame the challenges of normal PC operations.   I now have some explaining to do as to why Father Christmas can’t fit a Surface unit on his sleigh.

 

Related posts:

Surface Computers as Interactive Learning Platform for Kinesthetic Learners

Digital Play as an Alternative to Drugs

 

Read more at Wandy's Blog or connect with me on Twitter

 

P.S. EMC Consulting are currently recruiting.  If any of my ramblings interest you and you are passionate about User Experience then we'd like to hear from you.  Why not contact me and let's have a chat?

Comment Notification

If you would like to receive an email when updates are made to this post, please register here

Subscribe to this post's comments using RSS

Comments

 

Richard Monson-Haefel said:

Hi,

I really enjoyed reading this blog post and your analysis of Bel's experience both on a traditional computer and on surface.  I've posted my own blog where I talk about using Surface for education and I give a pointer to your blog.  I hope you don't mind if I used Bel's picture in my own blog post as I don't have a Surface unit yet and wanted to show a child interacting with the device.

Here is the blog entry:

http://theclevermonkey.blogspot.com/2008/11/children-and-microsoft-surface.html

Let's keep in touch. I plan to start designing applications for children as my first forays into Surface development. It would be interesting to compare notes if you decided to do the same thing.

All the best,

Richard

November 20, 2008 16:10
 

Jim Allen said:

I work for RM who are the largest producer of hardware and software for education in the UK; needless to say we are very interested in Surface and how it will benefit education.

We have been working closely with the product group for a while now and before Christmas did a Surface education proof of concept with the Microsoft Technology Centre in the UK to produce an app called Finguistics.

The DPE team from Microsoft shot a film about the development process which is interesting: http://www.youtube.com/watch?v=1Ae9yvA3Lhg

For me the more interesting video is when I went with the Education product group when they put a Surface device in a school for a couple of days, a first in the UK: http://www.youtube.com/watch?v=baDJNtBT1Fg

The video shows how kids just get Surface and how it lights them up. Hopefully we can get the momentum to make Surface a great addition to the classroom.

March 31, 2009 23:07
 

polly pearson said:

Okay, how do I get one?!  

I've long been a fan of virtual worlds for immersive, experiential learning and interaction, ever since experiencing one, and reading a quote by an MIT guy on the fact that we organize our digital information today in artificial, non-intuitive ways like html. Silly really. Especially when a more organic, natural feeling manner is now available.  Ones and zeros can be organized in a rich environment which feels natural ... the way human mind is meant to operate!

Kudos to the Microsoft team on this development!

And I have a 4 year old who would SIMPLY love this! (Your paint on the trousers illustration was an awesome visual!) Perhaps he could help me create his baby album, which I have yet to finish, and spent this last weekend tagging and arranging in the-digital-old-fashioned-way.

Thanks!

Polly Pearson

EMC HQ, Hopkinton, MA

June 17, 2009 23:36
 

Angela James said:

Very cool, I can't wait to play with one of these things. Hopefully I can buy one (for a small fortune of course) before my son hits kindergarten.

June 19, 2009 02:42
 

iam3ric said:

Your story was featured in iam3ric! Here is the link to vote it up and promote it: http://iam3ric.com/Technology/4_Year_Old_Tests_Microsoft_Surface

June 19, 2009 06:21
 

Craig said:

Her interaction with it in the 1-minute clip looks much less intentional and intuitive than what you describe.  The table is responding to her, and she isn't leading it to do anything "wrong" but that isn't the same as successful interaction.  You can look at it and say, "ooo, she's resizing and rotating pictures" but it doesn't seem like that's what she wants to do.  She does seem to be somewhat intentional about moving them around, but she's getting these undesired and distracting resize and rotate effects as byproducts of her normal 4-year-old coordination level.  At :16 it also looks like she tries to pick it up.  Instead the picture keeps jittering in size and orientation.  A very informative experiment, to be sure, and certainly more a more interactable device for a kid than a mouse, but it's still an imperfect approximation of reality.

June 19, 2009 06:25
 

Thibault said:

Thanks for sharing this video. It’s very informative.

(However I watched it without sound.)

I’m not sure it proves the point you’re trying to make (at least the one I understand): “Interacting with a touch screen is easier than interacting with a mouse for children.”

Mainly because there is no evidence comparing mouse vs touch screen vs keyboard to manipulate pictures.

And by “manipulating pictures” we need to define what kind of manipulations.

Here the action seems to be merely “seeing big pictures”.

A classic slideshow in that case would have been more efficient.

Then learning to press “arrow right” to see the next picture might be as effective as “sliding your finger from right to left” if not more.

And talking about “magic” the automatic full screen computation would have been more “magical” compared to this complicated gesture with two hands (on the video we see Isobel trying to scale up the pictures because they are too small and the rotation is obviously a great deal of distraction for her).

The video also shows the way we could organise photos.

Once again not in the more efficient way: pictures are stacked together creating the same real mess we would have with paper pictures.

It’s not very clear which one is on the top while she’s talking.

We can see a movie under her hand and that’s really interesting because what she’s manipulating is not any more “photos”.

It’s more.

It’s different.

But what is it then?

What’s the name of the stuff I’m touching on this table?

It’s me, but not only me.

Those are the questions she may ask herself.

And as soon as we’re trying to explain to her: “this is a movie, this is a photo”, we break her first natural understanding of “digital content” that ONLY exist through a screen.

As soon as she can put a name on it, she will have a better understanding about what she’s manipulating than adults.

To me this table shouldn’t try to re-create “reality”.

The table is real by itself by the new concepts it presents due to the nature of digital content.

Flexibility is the key but in the sense of “re-processing” that material thus allowing a greater creativity.

For Isobel manipulating the picture is neither right or wrong. It’s just the way it is.

If the objective is to train her co-ordination movements, I’m not sure manipulating a mouse or a touch screen are good exercises.

The problem is not the interactions we are struggling with but instead the concepts we want to interact with.

And digital content brings newer concepts that need to be learned, but they are not “simple”. Sometimes they don’t even have a name.

Thanks for reading.

Thibault.

June 19, 2009 11:32
 

Richard.Wand said:

Hi Craig & Thibault

Thanks for your comments.  It's fair to challenge whether her manipulation of the digital content is as a result of accidental interaction. You have not seen the full 2 hour footage (phew, I hear you say) or heard the audio.  I appreciate that without this fuller picture your judgement is limited to this mute clip, and this clip does not make it obvious whether the action is in response to an intended user input.

I will upload the same clip with audio.  In this you will hear the voice of a colleague (out of view) who is chatting with Bel and her actions are in direct response to requests such as 'can you make the photo larger?'

Bel plays with the Surface device for 15 minutes before this particular clip.  There is a learning curve for Bel which may be comparable to non-gestural interfaces, but once learnt she was able to interact with the Surface device far more than she can with a normal PC as these natural gestures overcome the challenges she has with normal PC operations.  Bel can manipulate photos and videos on sites such as CBeebies but lacks the precision control required with a mouse – the frustration she shows on such sites was not evident during her Surface experience.  

I'll sign off with the thought, watch a 4 year old use a mouse for the first time?

June 19, 2009 12:19
 

Dustin Beltramo said:

I've noticed the same thing with my four-year-old and the iPhone. He's always showing people how to use it, can easily get to the apps he wants to use, likes to use the simple drawing program and play with the swimming fish and choose movies to watch.

My son still can't use a mouse, gets frustrated easily and gives up. But he loves playing with the iPhone. And he's doing more than playing, he's accomplishing tasks that he sets out for himself.

Direct manipulation makes all the difference.

June 19, 2009 17:52

Leave a Comment

(required) 
(optional)
(required) 
Submit
Powered by Community Server (Personal Edition), by Telligent Systems