MICHI: AI-POWERED ROBOT FOR GUEST MANAGEMENT AND ASSISTANCE

Abstract

In today’s fast-paced corporate world, delivering a seamless and efficient guest experience is essential to reflect professionalism and build lasting trust. At PT Bintang Toedjoe, hospitality plays a crucial role in shaping a positive first impression, yet challenges arise when limited staff availability affects the consistency of guest interactions, especially during group visits. Guests may face delays or confusion due to a lack of guidance and immediate assistance, missing opportunities to showcase the company’s commitment to innovation and customer satisfaction. To address this, PT Bintang Toedjoe can adopt AI-powered robotic assistants as a smart, efficient solution to enhance guest management, provide real-time support, and create a smooth, welcoming experience aligned with the company’s vision of technological advancement. This project proposes a smart robot assistant integrating IoT components and AI. The system utilizes OpenAI’s LLM for response generation and Retrieval-Augmented Generation to access and incorporate information from external knowledge bases, which receive questions and return answers through the IoT components. The AI system focuses on processing the user’s input by converting audio into text, which is then processed by the LLM. The resulting text output is converted back into audio using ElevenLabs’ TTS API, providing natural and fast voice generation. The AI system also communicates with the IoT components via Flask and MQTT, handling audio input and output as well as prompts for the robot’s movements. Field simulations demonstrate that the AI model can return an audio response to the user with an average latency of 6–10 seconds, depending on the internet connection.

ii

These results suggest that the proposed system is capable of assisting and answering users’ questions during company visits