Visual inputs decrease brain activity in frontal areas during silent lipreading

Autoři: Julio Plata Bello aff001;  Carlos García-Peña aff001;  Cristián Modroño aff001;  Estefanía Hernández-Martín aff001;  Yaiza Pérez-Martín aff003;  Francisco Marcano aff001;  José Luis GonzálezMora aff001
Působiště autorů: Department of Physiology, Faculty of Medicine, University of La Laguna, S/C de Tenerife, Spain aff001;  Hospital Universitario de Canarias (Department of Neurosurgery), S/C de Tenerife, Spain aff002;  Hospital Universitario de Canarias (Department of Neurology), S/C de Tenerife, Spain aff003
Vyšlo v časopise: PLoS ONE 14(10)
Kategorie: Research Article
doi: 10.1371/journal.pone.0223782



The aim of the present work is to analyze the modulation of the brain activity within the areas involved in lipreading when an additional visual stimulus is included.


The experiment consisted of two fMRI runs (lipreading_only and lipreading+picture) where two conditions were considered in each one (oral speech sentences condition [OSS] and oral speech syllables condition [OSSY]).


During lipreading-only, higher activity in the left middle temporal gyrus (MTG) was identified for OSS than OSSY; during lipreading+picture, apart from the left MTG, higher activity was also present in the supplementary motor area (SMA), the left precentral gyrus (PreCG) and the left inferior frontal gyrus (IFG). The comparison between these two runs revealed higher activity for lipreading-only in the SMA and the left IFG.


The presence of a visual reference during a lipreading task leads to a decrease in activity in frontal areas.

Klíčová slova:

Functional magnetic resonance imaging – Language – Neuroimaging – Sensory perception – Speech – Syllables – Tongue – Vision


1. Hall DA, Fussell C, Summerfield AQ. Reading fluent speech from talking faces: typical brain networks and individual differences. J Cogn Neurosci. 2005;17: 939–53. doi: 10.1162/0898929054021175 15969911

2. Grant KW, Seitz PF. The use of visible speech cues for improving auditory detection of spoken sentences. J Acoust Soc Am. 2000;108: 1197–208. doi: 10.1121/1.1288668 11008820

3. Grant KW, Seitz PF. Measures of auditory-visual integration in nonsense syllables and sentences. J Acoust Soc Am. 1998;104: 2438–50. doi: 10.1121/1.423751 10491705

4. MacLeod A, Summerfield Q. Quantifying the contribution of vision to speech perception in noise. Br J Audiol. 1987;21: 131–41. 3594015

5. Bernstein LE, Liebenthal E. Neural pathways for visual speech perception. Front Neurosci. 2014;8: 386. doi: 10.3389/fnins.2014.00386 25520611

6. Jeffers J, Barley M. Speechreading: (Lipreading). Charles C Thomas Pub Ltd (1971);

7. Campbell R, MacSweeney M, Surguladze S, Calvert G, McGuire P, Suckling J, et al. Cortical substrates for the perception of face actions: an fMRI study of the specificity of activation for seen speech and for meaningless lower-face acts (gurning). Brain Res Cogn Brain Res. 2001;12: 233–43. 11587893

8. Calvert GA, Campbell R, Brammer MJ. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr Biol. 2000;10: 649–57. doi: 10.1016/s0960-9822(00)00513-3 10837246

9. Calvert G a, Campbell R. Reading speech from still and moving faces: the neural substrates of visible speech. J Cogn Neurosci. 2003;15: 57–70. doi: 10.1162/089892903321107828 12590843

10. Rizzolatti G, Arbib MA. Language within our grasp. Trends Neurosci. 1998;21: 188–94. doi: 10.1016/s0166-2236(98)01260-0 9610880

11. Liberman AM, Mattingly IG. The motor theory of speech perception revised. Cognition. 1985;21: 1–36. 4075760

12. Cattaneo L, Rizzolatti G. The mirror neuron system. Arch Neurol. 2009;66: 557–60. 19433654

13. Hickok G, Poeppel D. The cortical organization of speech processing. Nat Rev Neurosci. 2007;8: 393–402. doi: 10.1038/nrn2113 17431404

14. Hickok G. The cortical organization of speech processing: feedback control and predictive coding the context of a dual-stream model. J Commun Disord. 45: 393–402. doi: 10.1016/j.jcomdis.2012.06.004 22766458

15. Dodd B. The role of vision in the perception of speech. Perception. 1977;6: 31–40. doi: 10.1068/p060031 840618

16. McGurk H, MacDonald J. Hearing lips and seeing voices. Nature. 264: 746–8. doi: 10.1038/264746a0 1012311

17. Kislyuk DS, Möttönen R, Sams M. Visual processing affects the neural basis of auditory discrimination. J Cogn Neurosci. 2008;20: 2175–84. doi: 10.1162/jocn.2008.20152 18457500

18. Summerfield Q. Lipreading and audio-visual speech perception. Philos Trans R Soc Lond B Biol Sci. 1992;335: 71–8. doi: 10.1098/rstb.1992.0009 1348140

19. Kaplan E, Goodglass H, Weintraub S. Boston Naming Test. Lea, Febiger, editors. Philadelphia; 1983.

20. Oldfield RC. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia. 1971;9: 97–113. doi: 10.1016/0028-3932(71)90067-4 5146491

21. Maldjian JA, Laurienti PJ, Kraft RA, Burdette JH. An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets. Neuroimage. 2003;19: 1233–9. 12880848

22. Paulesu E, Perani D, Blasi V, Silani G, Borghese NA, De Giovanni U, et al. A functional-anatomical model for lipreading. J Neurophysiol. 2003;90: 2005–13. doi: 10.1152/jn.00926.2002 12750414

23. Paulesu E, Goldacre B, Scifo P, Cappa SF, Gilardi MC, Castiglioni I, et al. Functional heterogeneity of left inferior frontal cortex as revealed by fMRI. Neuroreport. 1997;8: 2011–7. doi: 10.1097/00001756-199705260-00042 9223094

24. Poldrack RA, Wagner AD, Prull MW, Desmond JE, Glover GH, Gabrieli JD. Functional specialization for semantic and phonological processing in the left inferior prefrontal cortex. Neuroimage. 1999;10: 15–35. doi: 10.1006/nimg.1999.0441 10385578

25. Friederici AD. Towards a neural basis of auditory sentence processing. Trends Cogn Sci. 2002;6: 78–84. 15866191

26. Bookheimer S. Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. Annu Rev Neurosci. 2002;25: 151–88. doi: 10.1146/annurev.neuro.25.112701.142946 12052907

27. Umarova RM, Saur D, Schnell S, Kaller CP, Vry M-S, Glauche V, et al. Structural connectivity for visuospatial attention: significance of ventral pathways. Cereb Cortex. 2010;20: 121–9. doi: 10.1093/cercor/bhp086 19406904

28. Rijntjes M, Weiller C, Bormann T, Musso M. The dual loop model: its relation to language and other modalities. Front Evol Neurosci. 2012;4: 9. doi: 10.3389/fnevo.2012.00009 22783188

29. Fridriksson J, Moss J, Davis B, Baylis GC, Bonilha L, Rorden C. Motor speech perception modulates the cortical language areas. Neuroimage. 2008;41: 605–13. doi: 10.1016/j.neuroimage.2008.02.046 18396063

30. Plata Bello J, Modroño C, Marcano F, González-Mora JL. Modulation in the mirror neuron system when action prediction is not satisfied. Eur J Neurosci. 2015;41. doi: 10.1111/ejn.12850 25722245

31. Duffau H. Stimulation mapping of white matter tracts to study brain functional connectivity. Nat Rev Neurol. 2015;11: 255–65. doi: 10.1038/nrneurol.2015.51 25848923

32. Schroeder CE, Lakatos P, Kajikawa Y, Partan S, Puce A. Neuronal oscillations and visual amplification of speech. Trends Cogn Sci. 2008;12: 106–13. doi: 10.1016/j.tics.2008.01.002 18280772

Článek vyšel v časopise


2019 Číslo 10