Black and white crayon drawing of a research lab

Enhancing IoT Interactions with Large Language Models: A Progressive Approach

Abstract

This paper explores the development and implementation of an Intelligent Virtual Assistant (IVA) leveraging Large Language Models (LLMs) to enhance interactions with Internet of Things (IoT) systems. Our work demonstrates the initial success in enabling the IVA to perform telemetry readings and basic interpretations, showcasing the potential of LLMs in transforming Natural Language Processing (NLP) applications within smart environments. We discuss the future enhancements planned for the IVA, including the ability to sequentially call multiple tools, perform readings from various sources, and execute robust data analysis. Specifically, we aim to fine-tune the LLM to translate human intentions into Prometheus queries and integrate additional analytical tools like MindDB to extend the system’s capabilities. These advancements are expected to improve the IVA’s ability to provide comprehensive responses and deeper insights, ultimately contributing to more intelligent and intuitive virtua l assistants. Our ongoing research highlights the potential of integrating advanced NLP, IoT, and data analytics technologies, paving the way for significant improvements in smart home and vehicle environments.

Authors

Daniela Timisica , Radu Boncea , Mariana Mocanu * , Bogdan Dura , Sebastian Balmus

* External Author

Journal

roceedings of the 27th International Conference on Enterprise Information Systems