How AI Decides What to See and What to Ignore

A Beginner's Guide to AI

This episode explores the concept of spatial attention, comparing how the human brain uses a 'mental spotlight' to process surroundings with

Key takeaways

• Human spatial attention can be goal-directed or captured by environmental stimuli like sudden movement.
• AI attention is a mathematical calculation of influence rather than a cognitive state of curiosity or worry.

Main topics

• Spatial Attention
• Computer Vision Mechanisms

Notable quotes

Seeing is not the same as noticing.

Conclusion

The episode concludes that while AI can extend human attention by scan

Transcript preview

Speaker 2 (0:00) You can look directly at something and still fail to notice it. AI has the same problem. It must decide which parts of an image matter and which parts it can ignore. Get that decision right and it can help doctors find disease or drivers spot danger. Get it wrong and the most important object may become effectively invisible. Today, how human and machine attention creates both intelligence and blind spots. Speaker 2 (0:42) The invisible spotlight, how brains and machines decide what matters. Welcome back to A Beginner's Guide to AI. I'm Professor Geffart, your youthful British marketing professor, synthetic voice and proof that even software can sound suspiciously pleased with itself. Imagine driving through a busy city. A cyclist approaches from the right. The traffic light changes. Someone steps towards a crossing while looking at a phone. Around them are buses, signs, parked cars, reflections, and an advert claiming that yogurt will transform your life. Your eyes receive all this information, but your brain does not examine every detail. It gives priority to the cyclist, the crossing, and the traffic light. Most other information moves into the background. This ability is called spatial attention. Think of it as a mental spotlight. It directs your limited processing power towards a specific part of your surroundings. The spotlight can become narrow when you search for your keys. It can become broad when you monitor a road. It can even move without your eyes moving. Sometimes you control it. You search a shelf for a product or follow a line of text. At other times, the environment takes control. A sudden movement, bright flash or warning signal pulls your attention towards it. This system is useful but imperfect. When people focus strongly on one thing, they can miss something obvious nearby. Magicians have built an entire profession around this problem. AI systems face a similar challenge. A camera can capture an entire road, medical scan or factory floor. But collecting an image is not the same as understanding it. The machine must decide which parts matter. Modern AI can assign different levels of importance to different parts of an image. A driving system may prioritize a small shape beside the road over a large patch of empty sky. A medical system may focus on an unusual area of tissue. A robot may give priority to the object it must pick up. This is also called attention. But AI attention is not the same as human attention. The machine does not become curious, worried or distracted. Attention is usually a mathematical process that determines which information has the most influence on the result. Humans also bring knowledge and expectations to a scene. If you see a ball roll into the road, you may expect a child to follow it. An AI might recognise the ball without recognising the story. Machines have their own advantages. They can combine several camera views, inspect infrared images, compare thousands of video frames, and continue working without requesting tea and annual leave. This means AI could extend human attention. It could warn a driver about a cyclist in a blind spot, help a doctor locate suspicious tissue, or search aerial images for missing people. The machine becomes a second spotlight, directing human attention towards something important. But who decides what deserves attention? An AI model learns from data and objectives. If its training data rarely contains a certain object, person, or unusual situation, the system may give it too little importance. Attention is never only about what gets selected. It is also about what gets ignored. During this episode, we will examine how spatial attention works, how AI creates its own functional version of it, and why machine attention is not the same as understanding. We will also ask whether AI can help us notice more or simply give us new ways to miss what matters. Seeing everything is impossible for brains and machines alike. Intelligence depends partly on knowing where to look. The danger begins when the spotlight points in the wrong direction. If you want every episode delivered to your mailbox, subscribe at beginnersguide.ai. Then you can focus your limited attention elsewhere while we remember when a new episode exists. Speaker 2 (4:50) Battle for the spotlight. Spatial attention begins with a simple problem. There is too much world and not enough brain. Your eyes receive a vast amount of visual information. If your brain examined every colour, movement, face and object with equal care, even buying milk would become an exhausting research project. The brain therefore creates priorities. It gives more processing power to some locations and less to others. This selection is spatial attention. Speaker 1 (5:19) Think of it as a spotlight. Speaker 2 (5:20) Objects inside the selected area become easier to detect and identify. You respond to them more quickly. Information outside that area receives less processing and becomes easier to miss. The spotlight can move even when your eyes remain still. Look at one word on a page while concentrating on a nearby word without moving your gaze. Your eyes continue to point at the first word, but your attention has shifted. This is called covert attention. When your eyes also move towards the object, you use overt attention. Attention often shifts first and your gaze follows. Spatial attention can come from two directions. Sometimes you control it. You search for a friend in a crowd or check the left side of the road before crossing. This is goal-directed attention. At other times, the environment takes control. A flash, sudden movement or warning signal pulls your attention towards it. A possible danger does not wait politely while you finish reading a menu. The two systems often compete. You may try to study a financial report while a notification appears on your phone. Your goal says, look at the quarterly figures. The screen says someone has sent a picture of a cat. Thousands of years of human development meet a group chat and the cat often wins. Attention can also change size. When you scan a crowd, your focus is broad. When you inspect one face, it becomes narrow. Psychologists have described this as a zoom lens. These metaphors are useful, but there is no physical spotlight inside the brain. Several brain regions work together to select locations, control eye movements, and strengthen relevant visual signals. This system is powerful but imperfect. Inattentional blindness occurs when people concentrate so strongly on one task that they fail to notice an unexpected object. Change blindness occurs when a major change between two scenes goes unnoticed because attention is directed elsewhere. The lesson is clear. Seeing is not the same