Design project: State of the local environment

As our design project, we are creating a concept for gathering people's opinions of their local environment. The project is made for the Ministry of Environment, and this concept will hopefully lead to a prototype created in the spring during the course Dynamic Visualization Design 2.

The design task here is to create a visualization of the two areas involved in this opinion gathering task:

1. Visualizing the data gathering method, e.g. a survey which the ministry hopes to be a cross platform app to use with primarily mobile, but also desktop devices.
2. Visualizing the gathered data, meaning the answers given via the app used to gather opinions.

Getting this project started has not perhaps been the easiest task. It is natural that as a team with all members having really varied backgrounds we all start to do our own things without paying that much attention to the big picture. This is well described by the fact that only a week after first hearing about the assignment we were already discussing what colors to use and where to add what kind of dots, though we hadn't even began to envision why anyone would actually want to use the app.

So, we needed to take a step back, create an outline and a scope for this project, and start putting the user before our what's-your-favorite-color discussions. Below is how we restricted the scope of this project, and divided it into relevant phases. 

I find this project espscially challenging because I have no prior experience in mobile app development and I don't have adequate knowledge of the GIS (Geolocation Information System) technology on which our visualizations should be based on. I don't think anyone in our group has good knowledge on this, so it will require a lot of effort to make this app happen.

But then again the less you know the more you learn, and fortunately our contact person from the ministry seems to be very motivated and willing to spend time on creating something that everyone is happy with.

We'll continue next week with a group meeting where we will discuss the user motives, and meet with our contact person to present our ideas.

Our presentation on visual attention

Two of the previous posts have already discussed some of the topics we covered in our theory presentation on Thursday 25.10. in detail, so this post intends to sum up and give some examples of what we discussed.

First of all, why do we need visual attention? 

Wouldn't it be more convenient to just perceive everything so we wouldn't miss out on important information?

When thinking about the amount of visual stimuli around us, it would be impossible for our brain to attend to everything and process it in a way that would allow us to effectively act upon the visual information we receive from our surroundings.

How does visual attention affect our perception?

According to Wolfe (2002) there are four types of "seeing" with different levels of attention:
1) Vision before attention: Some information is available prior to directing attention to an object
2) Vision with attention: Attention enables visual processing
3) Vision after attention: What happens after attention is deployed away from an object?
4) Vision without attention: What about the visual stimuli we never attend to?

The full text is available here for those interested in finding out more.

What does it mean that we don't perceive everything that goes on around us?

Here is a really good video you should watch to see this effect by yourself. Watch it now before reading on, because otherwise it's spoiled.

The idea is that when you focus closely to a task you omit all other, non-task-related information. In this case, the lady with an umbrella is unrelevant to the task at hand, so we fail to se her. At least I did the first time i watched the video.

This also happens when reading and searching information from the web. Commonly known as banner blindness, we are able to filter out information we don't expect to be relevant. If you have worked with or researched advertising, you might know that this is how the 'weak theory of advertising' explains what kind of ads affect us, suggesting this also happens outside the web environment.

How about our visual memory?

Simply put, its really bad. Watch this video if you don't believe it.

How bad our visual memory really is is pretty scary. I came across a really interesting presentation by Daniel Simmons about inattentional blindness. It's recorded at TEDxUIUC 2010 (4/10/10), and has really good examples on the real life implications of visual attention, and what it causes us to omit.

Visual attention can truly be a matter of life and death, as Simmons explains in his example on death rows based in eye witness testimonies gone wrong.

Finally, here are our presentation slides.

Visual Fixation

Fixation or visual fixation is the maintaining of the visual gaze on a single location. Humans (and other animals with a fovea) typically alternate saccades and visual fixations, the notable exception being in smooth pursuit, controlled by a different neural substrate that appear to have developed for hunting prey. 

Contrary to the old view, fixations are not simply the absence of eye movement; they are made up of much smaller movements. This is because should your eye be truly still, you would not actually be able to see as no neurons would fire. This has been demonstrated by retinal stabilization studies; a method of this is securing a contact lenses with a target image upon the eye; the visual stimulus moves in the same direction, speed and amplitude as the eye, so that the retinal image remains stable as eye movements are cancelled out.

After a few seconds, the image on the retina fades, thus showing that eye movements are needed to maintain visibility; there are three types of eye movements that support fixations.The photoreceptors need continuous stimulation to maintain visibility on a target, and there are three movements that make up fixations that achieve this. They are microsaccades, ocular drifts, and ocular microtremor. 

Microsaccades are miniature saccades, movement that corrects ocular drift and prevents fading. They are small, jerk-like, involuntary eye movements, similar to miniature versions of voluntary saccades. They typically occur during prolonged visual fixation (of at least several seconds), not only in humans, but also in animals with foveal vision (primates, cats, etc.). Microsaccade amplitudes vary from 2 to 120 arcminutes. 

It is notable that microsaccades have limited correctional accuracy, and also occur regardless of ocular drift. Furthermore, it was found that microsaccades are naturally suppressed by participants in complex attentional vision tasks such as threading a needle, suggesting that microsaccadic activity varies alongside the levels of focus, thus opening up new questions on how necessary microsaccades are. 

Ocular drifts are slow, random eye movements that drift away from the target of interest, and are said to be a consequence of neural noise.

Ocular microtremor is a constant, physiological, high frequency (peak 80Hz), low amplitude (estimated circa 150-2500nm) tremor of the eye, constant during the fixation period. Aside from stimulating the photoreceptors, the role of tremors in vision remains unclear. Although many aspects of these collective movements are under investigation to determine the purpose in vision, it is widely concluded that ocular drifts, micro saccades and tremors are at least necessary for maintaining visibility during fixations.

Visual Attention – Focus And Saccades

Focus

Our visual system differs from a digital camera in the way it detects and processes color but also in its resolution. On a digital camera’s photo censor, photoreceptive elements are spread uniformly in a tight matrix, so the spatial resolution is constant across the entire image frame. The human visual system is not like that.

The spatial resolution of the human visual field drops greatly from the center to the edges. Each eye has approximately six million retinal cone cells. They are packed much more tightly in the center of our visual field – a small region called the fovea – than they are at the edges of the retina. The fovea is only about 1% of the retina, but the brain’s visual cortex devotes about 50% of its area to input from the fovea. Furthermore, foveal cone cells connect 1:1 to the ganglian neuron cells that begin the processing and transmission of visual data, while elsewhere on the retina, multiple photoreceptor cells (cones and rods) connect to each ganglion cell. In technical terms, information from the visual periphery is compressed (with data loss) before transmission to the brain, while information from the fovea is not. All this causes our vision to have much, much greater resolution in the center of our visual field than elsewhere (Lindsay, P., Norman, D.A., Human information processing, 1972; Waloszek, G., Vision and Visual Disabilities: An Introduction, 2005).

To visualize how small the fovea is compared to your entire visual field, hold your arm straight out and look at your thumb. Your thumbnail, viewed at arm’s length, corresponds approximately to the fovea (Ware, C., Visual Thinking for Design, 2008). While you have your eyes focused on the thumbnail, everything else in your visual field falls outside of your fovea on your retina.

In the fovea, people with normal vision have very high resolution: they can resolve several thousand dots within that region – better resolution than many of today’s pocket digital cameras. Just outside of the fovea, the resolution is already down to a few dozen dots per inch viewed at arm’s length. At the edges of our vision, the “pixels” of our visual system are as large as a melon (or human head) at arm’s length.

If our peripheral vision has such low resolution, one might wonder why we don’t see the world in a kind of tunnel vision where everything is out of focus except what we are directly looking at now. Instead, we seem to see our surroundings sharply and clearly all around us. We experience this illusion because our eyes move rapidly and constantly about three times per second even when we don’t realize it, focusing our fovea on selected pieces of our environment. Our brain fills in the rest in a gross, impressionistic way based upon what we know and expect. Our brain does not have to maintain a high-resoltion mental model of our environment because it can order eyes to sample and resample details in the environment as needed (Clark, A., Being There: Putting brain, body, and world together again, 1998).

For example when reading your eyes dart around, scanning and reading. No matter where on the page your eyes are focused, you have the impression of viewing a complete page of text, because, of course, you are. 

Related to this is the fact that the center of our visual field – the fovea and a small area immediately surrounding it – is the only part of our visual field that can read. The rest of our visual field cannot read. What this really means is that the neural networks starting in the fovea, running through the optic nerve to the visual cortex, and then spreading into various parts of our brain, have been trained to read, but the neural networks starting elsewhere in our retinas cannot read. All text that we read comes into our visual system after being scanned by the central area, which means that reading requires a lot of eye movement (Johnson, Jeff, Designing with the Mind in Mind, 2010)

Saccades

Each eye is moved by six muscles. The tendon passes through a ‘pulley’ in the skull, in front of the eyeball. The eyes are in continuous movement, and they move in various ways. When the eyes are moved around, searching for an object, they move quite differently from the way they move when a moving object is being followed with the eyes. When searching, they move in a series of small rapid jerks, but when following they move smoothly. The jerks are known as saccades (after an old French word meaning ‘the flick of a sail’). Apart from these two main types of movement, there is also a continuous small high-frequency tremor.

It turns out that the saccadic movements of the eyes are essential to vision. It is possible to fix the image on the retina so that whenever the eye moves, the images move with it and so remain fixed on the retina. When the image is optically stabilised vision fades after a few seconds, and so it seems that part of the function of eye movements is to sweep the image over the receptors so that they do not adapt and so cease to signal to the brain the presence of the image in the eye. But there is a curious problem: when we look at a sheet of white paper, the edges of the image of the paper will move around on the retina, and so stimulation will be renewed; but consider now the centre of the image. Here the small movements of the eyes can have no effect, for a region of given brightness is substituted for another region of exactly the same brightness, and so no change in stimulation takes place with the small eye movements. Yet the middle of the paper does not fade away. This suggests that borders and outlines are very important in perception. Large areas of constant intensity provide no information. They seem to be ‘inferred’ from the signal borders: the central visual system makes up the missing signals. (Gregory R.L., Eye and Brain – The psychology of seeing, 3rd Ed., 1978)

We constantly make eye movements to seek information. Moving our eyes causes different parts of the visual environment to be imaged on the high-resolution fovea, where we can see detail. These movements are frequent, between two and five jerky movements, called saccades, per second.

In visual search task, the eye moves rapidly from fixation to fixation. The dwell period is generally between 200 and 600 msec, and the saccade takes between 20 and 100 msec. The peak velocity of a saccade can be as much as 900°/sec (Hallett, P.E., Eye movements. In Handbook of Perception and Human Performance, 1986; Barfield, W., Hendrix, et al., Comparison of human sensory capabilities with technical spefications of virtual environment equipment. Presence 4(4), 1995).

Saccadic eye movements are said to be ballistic. This means that once brain decides to switch attention and make an eye movement, the muscle signals for accelerating and decelerating the eye are first programmed, then the program is run to make the eye movement. The movement cannot be adjusted in mid-saccade. During the course of a saccadic eye movement, we are less sensitive to visual input than we normally are. This is called saccadic suppression (Riggs, L.A., Merton, et al., Suppression of visual phosphenes during saccadic eye movements. Vision Research 14, 1974). The implication is that certain kinds of events can easily be missed if they occur while we happen to be moving our eyes.

Another implication of saccadic suppression is that it is reasonable to think of information coming into the visual system as a series of discrete snapshots. The brain is often processing rapid sequences of discrete images. This capacity is being increasingly exploited in television advertising, in which several cuts per second of video have become commonplace. (Ware, Colin, Information Visualization: Perception for Design, 2nd Ed., 2004).