Dissociating the sequential dependency of subjective temporal order from subjective simultaneity

Autoři: Renan Schiavolin Recio aff001;  André Mascioli Cravo aff001;  Raphael Yokoingawa de Camargo aff001;  Virginie van Wassenhove aff002
Působiště autorů: Centro de Matemática, Computação e Cognição (CMCC), Universidade Federal do ABC (UFABC), São Bernardo do Campo, SP, Brazil aff001;  Cognitive Neuroimaging Unit CEA DRF/Joliot, INSERM, Université Paris-Sud, Université Paris-Saclay, NeuroSpin Center, Gif-sur-Yvette, Paris, France aff002
Vyšlo v časopise: PLoS ONE 14(10)
Kategorie: Research Article
doi: 10.1371/journal.pone.0223184


The physical simultaneity between two events can differ from our point of subjective simultaneity (PSS). Studies using simultaneity judgments (SJ) and temporal order judgments (TOJ) tasks have shown that whether two events are reported as simultaneous is highly context-dependent. It has been recently suggested that the interval between the two events in the previous trial can modulate judgments both in SJ and TOJ tasks, an effect named rapid recalibration. In this work, we investigated rapid recalibration in SJ and TOJ tasks and tested whether centering the range of presented intervals on perceived simultaneity modulated this effect. We found a rapid recalibration effect in TOJ, but not in SJ. Moreover, we found that centering the intervals on objective or subjective simultaneity did not change the pattern of results. Interestingly, we also found no correlations between an individual’s PSS in TOJ and in SJ tasks, which corroborates other studies in suggesting that these two psychophysical measures may capture different processes.

Klíčová slova:

Analysis of variance – Curve fitting – Experimental design – Psychometrics – Psychophysics – Sensory perception – Vision – Color vision


1. Parise CV, Spence C, Ernst MO. When correlation implies causation in multisensory integration. Current Biology. 2012;22(1):46–49. doi: 10.1016/j.cub.2011.11.039 22177899

2. Parise CV, Ernst MO. Correlation detection as a general mechanism for multisensory integration. Nature communications. 2016;7:11543. doi: 10.1038/ncomms11543 27265526

3. Deroy O, Faivre N, Lunghi C, Spence C, Aller M, Noppeney U. The complex interplay between multisensory integration and perceptual awareness. Multisensory research. 2016;29(6-7):585–606. doi: 10.1163/22134808-00002529 27795942

4. Kayser C, Shams L. Multisensory causal inference in the brain. PLoS biology. 2015;13(2):e1002075. doi: 10.1371/journal.pbio.1002075 25710476

5. Rohe T, Noppeney U. Cortical hierarchies perform Bayesian causal inference in multisensory perception. PLoS Biology. 2015;13(2):e1002073. doi: 10.1371/journal.pbio.1002073 25710328

6. Stein BE, Meredith MA. The merging of the senses. The MIT Press; 1993.

7. Ernst MO, Bülthoff HH. Merging the senses into a robust percept. Trends in cognitive sciences. 2004;8(4):162–169. doi: 10.1016/j.tics.2004.02.002 15050512

8. Pöppel E, Artin TT. Mindworks: Time and conscious experience. Harcourt Brace Jovanovich; 1988.

9. Sugita Y, Suzuki Y. Audiovisual perception: Implicit estimation of sound-arrival time. Nature. 2003;421(6926):911. doi: 10.1038/421911a 12606990

10. Kopinska A, Harris LR. Simultaneity constancy. Perception. 2004;33(9):1049–1060. doi: 10.1068/p5169 15560507

11. Heron J, Whitaker D, McGraw PV, Horoshenkov KV. Adaptation minimizes distance-related audiovisual delays. Journal of Vision. 2007;7(13):5–5. doi: 10.1167/7.13.5 17997633

12. Stone J, Hunkin N, Porrill J, Wood R, Keeler V, Beanland M, et al. When is now? Perception of simultaneity. Proceedings of the Royal Society of London B: Biological Sciences. 2001;268(1462):31–38. doi: 10.1098/rspb.2000.1326

13. Zampini M, Guest S, Shore DI, Spence C. Audio-visual simultaneity judgments. Perception & psychophysics. 2005;67(3):531–544. doi: 10.3758/BF03193329

14. Raizada R, Poldrack R. Event-related fMRI of audio-visual simultaneity perception. In: Journal of Cognitive Neuroscience. MIT Press five Cambridge center, Cambridge, MA 02142 USA; 2002. p. 172–172.

15. Van Wassenhove V, Grant KW, Poeppel D. Temporal window of integration in auditory-visual speech perception. Neuropsychologia. 2007;45(3):598–607. doi: 10.1016/j.neuropsychologia.2006.01.001 16530232

16. Vroomen J, Keetels M. Perception of intersensory synchrony: a tutorial review. Attention, Perception, & Psychophysics. 2010;72(4):871–884. doi: 10.3758/APP.72.4.871

17. Vatakis A, Spence C. Audiovisual synchrony perception for speech and music assessed using a temporal order judgment task. Neuroscience letters. 2006;393(1):40–44. doi: 10.1016/j.neulet.2005.09.032 16213656

18. Zampini M, Shore DI, Spence C. Audiovisual temporal order judgments. Experimental brain research. 2003;152(2):198–210. doi: 10.1007/s00221-003-1536-z 12879178

19. Zampini M, Shore DI, Spence C. Multisensory temporal order judgments: the role of hemispheric redundancy. International Journal of Psychophysiology. 2003;50(1-2):165–180. doi: 10.1016/s0167-8760(03)00132-6 14511844

20. Van Eijk RL, Kohlrausch A, Juola JF, van de Par S. Audiovisual synchrony and temporal order judgments: effects of experimental method and stimulus type. Perception & psychophysics. 2008;70(6):955–968. doi: 10.3758/PP.70.6.955

21. Vatakis A, Navarra J, Soto-Faraco S, Spence C. Audiovisual temporal adaptation of speech: temporal order versus simultaneity judgments. Experimental brain research. 2008;185(3):521–529. doi: 10.1007/s00221-007-1168-9 17962929

22. Fujisaki W, Shimojo S, Kashino M, Nishida S. Recalibration of audiovisual simultaneity. Nature neuroscience. 2004;7(7):773. doi: 10.1038/nn1268 15195098

23. Vroomen J, Keetels M, De Gelder B, Bertelson P. Recalibration of temporal order perception by exposure to audio-visual asynchrony. Cognitive brain research. 2004;22(1):32–35. doi: 10.1016/j.cogbrainres.2004.07.003 15561498

24. Kösem A, Gramfort A, van Wassenhove V. Encoding of event timing in the phase of neural oscillations. Neuroimage. 2014;92:274–284. doi: 10.1016/j.neuroimage.2014.02.010 24531044

25. Keetels M, Vroomen J. Temporal recalibration to tactile–visual asynchronous stimuli. Neuroscience letters. 2008;430(2):130–134. doi: 10.1016/j.neulet.2007.10.044 18055112

26. Van der Burg E, Alais D, Cass J. Rapid recalibration to audiovisual asynchrony. Journal of neuroscience. 2013;33(37):14633–14637. doi: 10.1523/JNEUROSCI.1182-13.2013 24027264

27. Van der Burg E, Orchard-Mills E, Alais D. Rapid temporal recalibration is unique to audiovisual stimuli. Experimental brain research. 2015;233(1):53–59. doi: 10.1007/s00221-014-4085-8 25200176

28. Harvey C, Van der Burg E, Alais D. Rapid temporal recalibration occurs crossmodally without stimulus specificity but is absent unimodally. Brain Research. 2014;1585:120–130. doi: 10.1016/j.brainres.2014.08.028 25148705

29. Noel JP, De Niear M, Van der Burg E, Wallace MT. Audiovisual simultaneity judgment and rapid recalibration throughout the lifespan. PloS one. 2016;11(8):e0161698. doi: 10.1371/journal.pone.0161698 27551918

30. Roseboom W. Serial dependence in timing perception. Journal of Experimental Psychology: Human Perception and Performance. 2019;45(1):100–110. doi: 10.1037/xhp0000591 30596435

31. Brainard DH, Vision S. The psychophysics toolbox. Spatial vision. 1997;10:433–436. doi: 10.1163/156856897X00357 9176952

32. Hill N. The Psignifit Toolbox; 2005.

33. Wichmann FA, Hill NJ. The psychometric function: I. Fitting, sampling, and goodness of fit. Perception & psychophysics. 2001;63(8):1293–1313. doi: 10.3758/BF03194544

34. JASP Team. JASP (Version 0.9)[Computer software]; 2018. Available from: https://jasp-stats.org/.

35. Grabot L, van Wassenhove V. Time order as psychological bias. Psychological science. 2017;28(5):670–678. doi: 10.1177/0956797616689369 28485701

36. Van Eijk RL, Kohlrausch A, Juola JF, Van De Par S. Temporal order judgment criteria are affected by synchrony judgment sensitivity. Attention, Perception, & Psychophysics. 2010;72(8):2227–2235. doi: 10.3758/BF03196697

37. Murray MM, Wallace MT. The neural bases of multisensory processes. CRC Press; 2011.

38. García Pérez MA, Alcalá Quintana R. On the discrepant results in synchrony judgment and temporal-order judgment tasks: a quantitative model. Psychonomic bulletin & review. 2012;19(5):820–846. doi: 10.3758/s13423-012-0278-y

39. Pernet CR, Wilcox RR, Rousselet GA. Robust correlation analyses: false positive and power validation using a new open source Matlab toolbox. Frontiers in psychology. 2013;3:606. doi: 10.3389/fpsyg.2012.00606 23335907

40. Keane B, Bland NS, Matthews N, Carroll TJ, Wallis G. Rapid recalibration of temporal order judgements: Response bias accounts for contradictory results. BioRxiv. 2019; p. 576249.

41. Love SA, Petrini K, Cheng A, Pollick FE. A psychophysical investigation of differences between synchrony and temporal order judgments. PloS one. 2013;8(1):e54798. doi: 10.1371/journal.pone.0054798 23349971

Článek vyšel v časopise


2019 Číslo 10