We aim to study specific forms of social interaction using state-of-the-art technology - virtual reality (VR) which is motivated by its known benefits. The project has two main parts, human–robot interaction (HRI) and therapist–patient interaction (TPI). The interactions are enabled using head-mounted displays and controllers allowing the human to act in VR. We propose two research avenues going beyond the state-of-the-art in respective contexts. In HRI, we will develop scenarios allowing the humanoid robot to learn, understand and imitate human motor actions using flexible feedback. We develop scenarios for testing and validating human trust in robot behavior. We will also investigate physical interaction with a humanoid robot NICO. In TPI with stroke patients, we develop a series of VR-based occupational therapy procedures for motor and cognitive impairment neurorehabilitation using an active and passive BCI, and we will validate these procedures...
Computational modelling of early development of social skills in human-robot interaction (VEGA 1/0645/21) 2023-2025This project focuses on modelling early forms of human-robot collaboration, based on a developmental approach to cognition that stresses the importance of learning. The key expected contribution is in identifying a minimal set of cognitive mechanisms enabling early collaborative behaviors such as response contingency, intention recognition and turn-taking, and how these mechanisms arise from experience. We will use simple scenarios of block manipulation tasks, in which a human demonstrates a sequence of actions, such as building a tower. We will design and implement neural network models of robot’s cognitive development starting from visuomotor coordination, learning sequences by observation, replicating an observed sequence individually and also collaboratively with the human...
Learning of a robotic system in a human-robot interaction (VEGA 1/0796/18)The project goal is to design, implement and test a robotic system (arm with a gripper, and two cameras) that would, in an interaction with a human, learn to execute commands, respond to questions, comment its own actions as well as those of a human. To make the tasks manageable, the interaction will focus on simple sensory-motor actions, such as object manipulation on a table. Project aims to yield novel insights into embodied cognitive processing and especially its developmental aspects, since most of the mechanisms will not be pre-programmed, but learned, using mostly artificial neural networks...
Enhancing cognition and motor rehabilitation in mixed reality (APVV-16-0202)Technological advancements based on mixed reality (MR) offer various challenges for research and medical treatment. The project focuses on two objectives related to healthy subjects and hemiparetic patients after stroke. First, we will test the hypothesis whether cognitive training using appropriately designed MR environment will enhance perceptual and cognitive performance in healthy subjects. This will be tested by computerized psychological experiments as well as by measuring event-related potentials or ERPs. Second, we will test the hypothesis whether experience with training in MR (in combination with motor-imagery based brain-computer interface developed by us) will enhance oscillatory sensory-motor rhythms....