Research

Action

Mechanisms of stability and transition are central to effective action and interaction. We must constantly adjust our motor system to achieve stable, goal-directed interactions with the outside world. Here, we use motor control as a particularly rich system for probing adaptation processes. This allows us to investigate how the other Key Areas are affected when the individual is coupled to the environment.

New project-related publications
Arikan, B. E., van Kemenade, B. M., Fiehler, K., Kircher, T., Drewing, K., & Straube, B. (2021).
Different contributions of efferent and reafferent feedback to sensorimotor temporal recalibration.
Scientific Reports, 11(1).
DOI
Aubret, A., Ernst, M.R., Teulière, C., & Triesch, J. (2023).
Time to Augment Contrastive Learning.
IEEE Int. Conf. on Learning Representations (ICLR).
Aubret, A., Teulière, C., & Triesch, J. (2022).
Toddler-inspired embodied vision for learning object representations.
IEEE Int. Conf. on Development and Learning (ICDL).
Augustat, N., Chuang, L. C., Panitz, C., Stolz, C., Mueller, E. M., & Endres, D. M. (2022).
Modeling Reward Learning Under Placebo Expectancies: A Q-Learning Approach.
In Proceedings of the Annual Meeting of the Cognitive Science Society.
DOI
Bahmani, S., Hahn, O., Zamfir, E., Araslanov, N., Cremers, D., & Roth, S. (2022).
Semantic Self-adaptation: Enhancing Generalization with a Single Sample. Transactions on Machine Learning Research (TMLR).
DOI
Bellagente, M., Brack, M., Teufel, H., Friedrich, F., Deiseroth, B., Eichenberg, C., Kersting, K., ... & Weinbach, S. (2024).
Multifusion: Fusing pre-trained models for multi-lingual, multi-modal image generation.
Advances in Neural Information Processing Systems, 36.
DOI
Brack, M., Friedrich, F., Hintersdorf, D., Struppek, L., Schramowski, P., & Kersting, K. (2024).
SEGA: Instructing text-to-image models using semantic guidance.
Advances in Neural Information Processing Systems, 36.
DOI
Brack, M., Schramowski, P., Deiseroth, B., & Kersting, K. (2023).
Illume: Rationalizing vision-language models through human interactions.
DOI
Cheeseman, J. R., Fleming, R. W., & Schmidt, F. (2022).
Scale ambiguities in material recognition.
iScience, 25(3):103970.
DOI
Churan, J., Kaminiarz, A., Schwenk, J. C., & Bremmer, F. (2021).
Coding of interceptive saccades in parietal cortex of macaque monkeys.
Brain Structure and Function, 226(8), 2707-2723.
Churan, J., Kaminiarz, A., Schwenk, J. C., & Bremmer, F. (2021).
Action-dependent processing of self-motion in parietal cortex of macaque monkeys.
Journal of Neurophysiology, 125(6), 2432-2443.
Cuevas, P., He, Y., Steines, M., & Straube, B.Cuevas, P., He, Y., Steines, M., & Straube, B. (2022).
Processing of Semantic Complexity and Cospeech Gestures in Schizophrenia: A Naturalistic, Multimodal fMRI Study.
Schizophrenia Bulletin Open, 3(1), sgac026.
DOI
Deiseroth, B., Deb, M., Weinbach, S., Brack, M., Schramowski, P., & Kersting, K. (2024).
Atman: Understanding transformer predictions through memory efficient attention manipulation.
Advances in Neural Information Processing Systems, 36.
Dillmann, J.*, Sensoy, Ö.*, & Schwarzer, G. (2022). *shared first authorship
Parental perceived stress and its consequences on early social-emotional child development during COVID-19 pandemic.
Journal of Early Childhood Research, 1476718X221083423.
Dowiasch, S., Blanke, M., Knöll, J., & Bremmer, F. (2023).
Spatial localization during open-loop smooth pursuit.
Frontiers in Neuroscience, 17, 1058340.
DOI
Dowiasch, S., Kaminiarz, A., & Bremmer, F. (2022).
The visual representation of space in the primate brain.
Neuroforum, 28(4), 199-209.
Eckert, A. L., Pabst, K., & Endres, D. M. (2022).
A Bayesian model for chronic pain.
Frontiers in Pain Research, 152.
DOI
Eckert, A. L., Pawlowski, J., Rief, W., Endres, D., & Kirchner, L. (2023).
Simulating Active Inference of Interpersonal Context Within and Across Mental Disorders.
PsyArXiv Preprints
DOI
Eckert, A., Blume, J. S., Knopp, B., Schütz, A. C., & Endres, D. (2024).
Distinct Biases Shape Perceptual Inference Dynamics Along the Autism-Psychosis Spectra.
DOI
Eckert, A., Fuehrer, E., Schmitter, C., Straube, B., Fiehler, K., & Endres, D. (2024).
Modelling Sensory Attenuation as Bayesian Causal Inference across two Datasets.
DOI DOI
Engel, D., Greulich, R. S., Parola, A., Vinehout, K., Dowiasch, S., Waldthaler, J., ... & Bremmer, F. (2023).
Convolutional neural network reveals frequency content of medio-lateral COM body sway to be highly predictive of Parkinson's disease.
medRxiv, 2023-05.
Engel, D., Student, J., Schwenk, J. C., Morris, A. P., Waldthaler, J., Timmermann, L., & Bremmer, F. (2021).
Visual perturbation of balance suggests impaired motor control but intact visuomotor processing in Parkinson’s disease.
Journal of Neurophysiology, 126(4), 1076-1089.
DOI
Falck, J., Zhang, L., Raffington, L., Mohn, J. J., Triesch, J., Heim, C., & Shing, Y. L. (2023).
Longitudinal Changes in Value-based Learning in Middle Childhood: Distinct Contributions of Hippocampus and Striatum.
bioRxiv preprint
DOI
Flachot, A., Akbarinia, A., Schütt, H. H., Fleming, R. W., Wichmann, F. A., & Gegenfurtner, K. R. (2022).
Deep neural models for color classification and color constancy.
Journal of vision, 22(4), 17-17.
DOI DOI
Friedrich, F., Stammer, W., Schramowski, P., & Kersting, K. (2023).
A typology for exploring the mitigation of shortcut behaviour.
Nature Machine Intelligence, 5(3), 319-330.
DOI DOI
Friedrich, F., Stammer, W., Schramowski, P., Kersting, K. (2023).
Revision Transformers: Instructing Language Models to Change their Values. In
Proceedings of the 26th European Conference on Artificial Intelligence (ECAI).
DOI
Gehb, G., Vesker, M., Jovanovic, B., Bahn, D., Kauschke, C., & Schwarzer, G. (2022).
The Relationship between Crawling and Emotion Discrimination in 9- to 10-Month-Old Infants.
Brain Sciences, 12(4), 479.
DOI
Göksu, Y., De Almeida Correia, A., Prasad, V., Kshirsagar, A., Koert, D., Peters, J., & Chalvatzaki, G. (2024).
Kinematically Constrained Human-like Bimanual Robot-to-Human Handovers.
Companion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction, 497-501.
Hahne, F., Prasad, V., Kshirsagar, A., Koert, D., Stock-Homburg, R. M., Peters, J., & Chalvatzaki, G. (2024).
Transition State Clustering for Interaction Segmentation and Learning.
Companion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction, 512-516.
Hesse, R., Schaub-Meyer, S., & Roth, S. (2021).
Fast axiomatic attribution for neural networks.
Advances in Neural Information Processing Systems, 34(2), 19513-19524.
DOI
Kadner, F., Thomas, T., Hoppe, D., & Rothkopf, C. A. (2023).
Improving saliency models' predictions of the next fixation with humans' intrinsic cost of gaze shifts.
In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (pp. 2104-2114).
Kaiser, D., Stecher, R., Dörschner-Boyaci, K. (2023).
EEG decoding reveals neural predictions for naturalistic material behaviors.
bioRxiv preprint
DOI
Kavroulakis, E., van Kemenade, B. M., Arikan, B. E., Kircher, T., & Straube, B. (2022).
The effect of self- vs. externally generated actions on timing, duration and amplitude of BOLD response for visual feedback processing.
Human Brain Mapping, in press.
Kessler, F., Frankenstein, J., & Rothkopf, C. A. (2022).
A Dynamic Bayesian Actor Model explains Endpoint Variability in Homing Tasks.
bioRxiv
Kirchner, L., Eckert, A., Berg, M., Endres, D., Straube, B., & Rief, W. (2022).
Better safe than sorry? - An active inference approach to biased inference on social contexts in depression.
PsyArXiv Preprints
König, A., Bremmer, F., Dowiasch, S. (2023).
Quantitative comparison of a mobile, tablet-based and two stationary, video-based eye-trackers.
bioRxiv, 2023-06.
Linka, M., Sensoy, Ö., Karimpur, H., Schwarzer, G., de Haas, B. (2022).
Attentional biases in free viewing of complex scenes in preschoolers and adults.
PsyArXiv Preprints
DOI
Linka, M., Sensoy, Ö., Karimpur, H., Schwarzer, G., de Haas, B. (2023).
Free viewing biases for complex scenes in preschoolers and adults.
Sci Rep, 13, 11803.
DOI
López, F. M., Shi, B. E., & Triesch, J. (2023).
Eye-Hand Coordination Develops from Active Multimodal Compression.
2023 IEEE International Conference on Development and Learning (ICDL) ,437-442.
Lubinus, C., Einhäuser, W., Schiller, F., Kircher, T., Straube, B. & van Kemenade, B.M. (2022).
Action-based predictions affect visual perception, neural processing, and pupil size, regardless of temporal predictability.
NeuroImage, 263, 119601.
DOI
Mattern, D., López, F.M., Ernst, M.R., Aubret, A., & Triesch, J. (2022).
MIMo: A Multi-Modal Infant Model for Studying Cognitive Development in Humans and AIs.
IEEE Int. Conf. on Development and Learning (ICDL), accepted.
Mattern, D., Schumacher, P., López, F. M., Raabe, M. C., Ernst, M. R., Aubret, A., & Triesch, J. (2024).
MIMo: A Multi-Modal Infant Model for Studying Cognitive Development.
IEEE Transactions on Cognitive and Developmental Systems.
DOI
Meibodi, N., Abbasi, H., Schubö, A., & Endres, D. M. (2021).
A model of selection history in visual attention.
In Proceedings of the Annual Meeting of the Cognitive Science Society 43(43), 707-713.
DOI
Meibodi, N., Schubö, A., & Endres, D. (2022).
Sensorimotor processes are not a source of much noise: sensorimotor and decision components of reaction times.
In Proceedings of the Annual Meeting of the Cognitive Science Society.
DOI
Niehaus, H.,Stroth, S., Kamp-Becker, I., Endres, D. (2022).
Modeling aberrant volatility estimates in Autism Spectrum Disorder.
In Proceedings of the Annual Meeting of the Cognitive Science Society.
DOI DOI
Ody, E., Straube, B., He, Y., Kircher, T. (2023).
Perception of self-generated and externally-generated visual stimuli: Evidence from EEG and behavior.
Psychophysiology, e14295.
DOI
Osorio, S., Straube, B., Meyer, L., & He, Y. (2023).
The role of co-speech gestures in retrieval and prediction during naturalistic multimodal narrative processing.
Language, Cognition and Neuroscience, 1-16.
O’Leary, A., Fernàndez-Castillo, N., Gan, G., Yang, Y., Yotova, A. Y., Kranz, T. M., ... Kircher, T. …, Straube, B., ... Reif, A. (2022).
Behavioural and functional evidence revealing the role of RBFOX1 variation in multiple psychiatric disorders and traits.
Molecular Psychiatry, 1–10.
Pabst, K., Zittrell, F., Homberg, U., Endres, D. (2022).
A Model for Optic Flow Integration in Locust Central-Complex Neurons Tuned to Head Direction.
In Proceedings of the Annual Meeting of the Cognitive Science Society.
DOI
Preißler, L., Jovanovic, B., Munzert, J., Schmidt, F., Fleming, R.W., & Schwarzer, G. (2021).
Effects of visual and visual-haptic perception of material rigidity on reaching and grasping in the course of development.
Acta Psychologica, 221, November, 103457.
Preißler, L., Keck, J., Krüger, B., Munzert, J., & Schwarzer, G. (2023).
Recognition of emotional body language from dyadic and monadic point-light displays in 5-year-old children and adults.
Journal of Experimental Child Psychology, 235, 105713.
Prokott, E., & Fleming, R. W. (2022).
Identifying specular highlights: Insights from deep learning.
Journal of vision, 22(7), 6-6.
Raabe, M. C., López, F. M., Yu, Z., Caplan, S., Yu, C., Shi, B. E., & Triesch, J. (2023).
Saccade Amplitude Statistics are Explained by Cortical Magnification.
2023 IEEE International Conference on Development and Learning (ICDL) ,300-305.
Ridderbusch, I. C., Wroblewski, A., Yang, Y., Richter, J., Hollandt, M. Hamm, A. O., Wittchen, H.-U., Ströhle, A., Arolt, V., Margraf, J., Lueken, U., Hermann, M. J., Kircher, T. & Straube, B. (2021).
Neural adaptation of cingulate and insular activity during delayed fear extinction: A replicable pattern across assessment sites and repeated measurements.
NeuroImage, 237, 118157.
Riedl, L., Nagels, A., Sammer, G., Choudhury, M., Nonnenmann, A., ... & Straube, B. (2022).
Changes in Neural Processing After Multimodal Speech-Gesture Training in Patients With Schizophrenia.
OHBM conference. 237, 118157.
Riedl, L., Nagels, A., Sammer, G., Choudhury, M., Nonnenmann, A., Sütterlin, A., Feise, C., Haslach, M., Bitsch, F., Kühne, H., Hartmann, T.H., Shvetsova, N. & Straube, B. (2022).
Multimodal speech-gesture training in patients with schizophrenia spectrum disorder: Effects on quality of life and neural processing.
Schizophrenia Research, 246, 112-125.
DOI
Rosenblum, L., Grewe, E., Churan, J., & Bremmer, F. (2022).
Influence of Tactile Flow on Visual Heading Perception.
Multisensory Research, 35(4), 291-308.
Rosenblum, L., Kreß, A., Ezgi Atikan, B., Straube, B., Bremmer, F. (2023).
Neural correlates of visual and tactile path integration and their task related modulation.
Scientific Reports, 13 (1), 9913.
DOI
Rosenblum, L., Kreß, A., Schwenk, J. C., & Bremmer, F. (2022).
Visuo-tactile heading perception.
Journal of Neurophysiology, 128(5), 1355-1364.
Rothkopf, C., Bremmer, F., Fiehler, K., Dobs, K., & Triesch, J. (2023).
Models of vision need some action.
Behavioral Brain Science, 46:e405.
Schaumlöffel, T., Aubret, A., Roig, G., & Triesch, J. (2023).
Caregiver Talk Shapes Toddler Vision: A Computational Study of Dyadic Play.
2023 IEEE International Conference on Development and Learning (ICDL) ,67-72.
Schmidt, F., Tiedemann, H., Fleming, R. W., & Morgenstern, Y. (2023).
Inferring shape transformations in a drawing task.
Memory & Cognition.
DOI
Schmitt, C., Schwenk, J. C. B., Schütz, A., Churan, J., Kaminiarz, A., Bremmer, F. (2021).
Preattentive processing of visually guided self-motion in humans and monkeys.
Progress in Neurobiology, 205, 102117.
Schmitter, C. V., Pazen, M., Uhlmann, L., van Kemenade, B. M., Kircher, T., & Straube, B. (2024).
Predictive neural processing of self-generated hand and tool actions in patients with schizophrenia spectrum disorders and healthy individuals.
OSFPreprints
Schmitter, C.V., Kufer, K., Steinsträter, O., Sommer, J., Kircher, T., Straube, B. (2023).
Neural correlates of temporal recalibration to delayed auditory feedback of active and passive movements.
Human Brain Mapping.
Schneider, F., Xu, X., Ernst, M. R., Yu, Z., & Triesch, J. (2021).
Contrastive Learning Through Time.
In SVRHM 2021 Workshop@ NeurIPS.
DOI
Schramowski, P., Brack, M., Deiseroth, B., & Kersting, K. (2023).
Safe latent diffusion: Mitigating inappropriate degeneration in diffusion models. In
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition(pp. 22522-22531).
Schramowski, P., Turan, C., Andersen, N., Rothkopf, C. A., & Kersting, K. (2022).
Large pre-trained language models contain human-like biases of what is right and wrong to do.
Nature Machine Intelligence, 4(3), 258-268.
DOI DOI DOI
Schülke, R., Schmitter, C., Straube, B. (2023).
Improving Causality Perception Judgments in Schizophrenia Spectrum Disorder via Transcranial Direct Current Stimulation.
Journal of Psychiatry & Neuroscience, 48(4), 245–254.
DOI
Schultheis, M., Rothkopf. C. A., Koeppl, H. (2022).
Reinforcement learning with non-exponential discounting.
Neural Information Processing Systems.
DOI
Schultheis, M., Straub, D., & Rothkopf, C. A. (2021).
Inverse optimal control adapted to the noise characteristics of the human sensorimotor system.
Advances in Neural Information Processing Systems, 34, 9429-9442.
DOI
Schwarzer, G., Gehb, G., Kelch, A., Gerhard-Samunda, T., Jovanovic, B. (2022).
Locomotion training contributes to 6-month-old infants' mental rotation ability.
Human Movement Science, Volume 85, October 2022, 102979.
Shindo, H., Pfanschilling, V., Dhami, D. S., & Kersting, K. (2023).
α ILP: thinking visual scenes as differentiable logic programs.
Machine Learning, 112(5), 1465-1497.
DOI DOI
Skryagin, A., Ochs, D., Dhami, D. S., & Kersting, K. (2023).
Scalable Neural-Probabilistic Answer Set Programming.
Journal of Artificial Intelligence Research (JAIR) 78:579–617.
DOI
Stewart, E. M. M., & Fleming, R. W. (2023).
The eyes anticipate where an object will move based on its shape.
Current Biology, 33(17), R894-R895.
DOI
Stewart, E. M., & Fleming R. W. (2023).
The eyes anticipate where an object will move based on its shape.
Current Biology, 33(17), R894-R895.
Stewart, E.E.M., Hartmann, F.T., Morgenstern, Y., Storrs, K.R., Maiello G., & Fleming R.W. (2022).
Mental object rotation based on two-dimensional visual representations.
Current Biology 32, R1201–R1225.
DOI
Storrs, K. R., Anderson, B. L., & Fleming, R. W. (2021).
Unsupervised learning predicts human perception and misperception of gloss.
Nature Human Behaviour, 1-16.
DOI
Straub, D., Schultheis, M., Koeppl, H., & Rothkopf, C. A. (2024).
Probabilistic inverse optimal control for non-linear partially observable systems disentangles perceptual uncertainty and behavioral costs.
Advances in Neural Information Processing Systems, 36.
DOI
Straube, B., Kuehne, H., van Dam, L., Frey, K., van Kemenade, B.M., Kircher, T., & Ried, L. (2022).
Speech-gesture mismatch detection in individuals with high vs. low schizotypal traits.
International Consortium on Schizotypy Research, ICSR 2022.
Stroth, S., Niehaus, H., Wolff, N., Poustka, L., Roessner, V., Kamp‐Becker, I., & Endres, D. (2022).
Subdimensions of social‐communication behavior in autism—A replication study.
JCPP Advances, e12077.
Student J, Engel D, Timmermann L, Bremmer F, Waldthaler J (2022).
Visual Perturbation Suggests Increased Effort to Maintain Balance in Early Stages of Parkinson’s to be an Effect of Age Rather Than Disease.
Front. Hum. Neurosci. 16:762380.
Tamura, H., Prokott, K. E., & Fleming, R. W. (2022).
Distinguishing mirror from glass: A “big data” approach to material perception.
Journal of vision, 22(4), 4-4.
DOI
Tatai, F., Straub, D., & Rothkopf, C. (2023).
People use Newtonian physics in intuitive sensorimotor decisions under risk. In
Proceedings of the Annual Meeting of the Cognitive Science Society (Vol. 45, No. 45).
Thoma, N., Yu, Z., Ventola, F., & Kersting, K. (2021).
RECOWNs: Probabilistic Circuits for Trustworthy Time Series Forecasting.
Proceedings of the 4th Workshop on Tractable Probabilistic Modeling (TPM 2021).
DOI
Thomas, T., Straub, D., Tatai, F., Shene, M., Tosik, T., Kersting, K., & Rothkopf, C. A. (2024).
Modelling dataset bias in machine-learned theories of economic decision-making.
Nature Human Behaviour, 1-13.
DOI DOI
Tiedemann, H., Morgenstern, Y., Schmidt, F., & Fleming, R. W. (2022).
One-shot generalization in humans revealed through a drawing task.
eLife, 11.
DOI
Tiedemann, H., Schmidt, F., Fleming, R.W. (2022).
Superordinate Categorization Based on the Perceptual Organization of Parts.
Brain Sciences, 12, 667.
DOI
Trick, S., & Rothkopf, C. A. (2022).
Bayesian Classifier Fusion with an Explicit Model of Correlation.
In International Conference on Artificial Intelligence and Statistics (pp. 2282-2310). PMLR.
DOI
Ventola, F., Dhami, D. S., & Kersting, K. (2021).
Generative Clausal Networks: Relational Decision Trees as Probabilistic Circuits.
Proceedings of the 30th International Conference on Inductive Logic Programming (ILP).
DOI DOI
Wroblewski, A., Hollandt, M., Yang, Y., Ridderbusch, I. C., Pietzner, A., Szeska, C., ... & Richter, J. (2022).
Sometimes I feel the fear of uncertainty stinging clear: How Intolerance of Uncertainty and Trait Anxiety impact fear acquisition, extinction and the return of fear.
Wroblewski, A., Hollandt, M., Yang, Y., Ridderbusch, I.C., Pietzner, A., Szeska, C., Lotze, M., Wittchen, H.-U., Heinig, I., Pittig, A., Arolt, V., Koelkebeck, K., Rothkopf, C.A., Adolph, D., Margraf, J., Lueken, U., Pauli, P., Herrmann, M.J., Winkler, M.H., Ströhle, A., Dannlowski, U., Kircher, T., Hamm, A.O., Straube, B.* & Richter, J.* (2022). *contributed equally
Sometimes I feel the fear of uncertainty stinging clear: How Intolerance of Uncertainty and Trait Anxiety impact fear acquisition, extinction and the return of fear.
PsyArXiv Preprints
Yu, Z., Dhami, D. S., & Kersting, K. (2021).
Sum-Product-Attention Networks: Leveraging Self-Attention in Probabilistic Circuits.
arXiv preprint
DOI
Yu, Z., Trapp, M., & Kersting, K. (2024).
Characteristic Circuits.
Advances in Neural Information Processing Systems, 36.
DOI
Yu, Z., Ventola, F. G., & Kersting, K. (2021).
Whittle networks: A deep likelihood model for time series.
International Conference on Machine Learning (PMLR), 12177-12186.
DOI
Yu, Z., Zhu, M., Trapp, M., Skryagin, A., & Kersting, K. (2021).
Leveraging Probabilistic Circuits for Nonparametric Multi-Output Regression.
Proceedings of the 37th Conference on Uncertainty in Artificial Intelligence (UAI 2021).
DOI
Zečević, M., Dhami, D. S., Rothkopf, C. A., & Kersting, K. (2021).
Structural Causal Interpretation Theorem.
arXiv preprint