About LAPIS projects

Scientific projects

Young Researcher's Career Development Project ExQuMe - Explaining Quantum Mechanics SAFER - Smart AI- and IoT-based Fire Extinguisher CPM Smart Predictive Analytics for Reliable Turbine Assets AERONAUT - Advancing research capacities for the development of autonomous marine-aerial systems for novel Adriatic applications Nonverbal Communication-Based Adaptive Learning Model for Interactive AI Agents Virtual - transfer - Technology Transfer of an Affective Virtual Being for Immersive Interaction AMICORC Project ACRON - A New Concept of Applied Cognitive Robotics in Clinical Neuroscience Mixed reality applications

Student projects

Implementation of portable neural networks using Docker containerization Automated microclimate control system for indoor plant cultivation Virtual agent with verbal communication in a virtual environment Robotic plotter for printing photos in the vertical plane A mechanism for directing the virtual agent's gaze based on sound and visual input A robotic manipulator for printing photos Computational model for classification and counting of push-ups Data transmission between two computers using blockchain technology Artificial intelligence and virtual reality in creating interactive 3D environments Automated label quality control using computer vision and a collaborative robot

Virtual agent with verbal communication in a virtual environment

Student: Filip Rebić

The topic of this work is the integration of the ChatGPT service with a virtual agent for the purpose of achieving verbal communication in the field of virtual reality and affective robotics. The theoretical part of the thesis presents natural language processing methods and their applications, and also analyzes the ways of integrating the ChatGPT service with the Unreal Engine 5 development environment. The practical part of the thesis includes the implementation of a virtual agent based on the ChatGPT service, including software support for speech-to-text and text-to-speech conversion, as well as the animation of facial expressions of a virtual human model in accordance with the generated speech.

Repository: https://repozitorij.fsb.unizg.hr/object/fsb:13778