Since the outburst of electric vehicles, the level of intelligence of the vehicles are rising day by day. The rapid advancement in vehicle infotainment systems has heightened the need for effective and efficient testing methodologies. Our project, sponsored by GM China, aims at developing an automated test tool designed to simulate human interactions with vehicle infotainment systems. This tool combines a sliding table with a robotic arm equipped with a capacitive pen and advanced computer vision algorithms to perform precise and repeatable testing processes. By automating interactions with the graphical user interface (GUI) of infotainment systems, our tool captures screen images before and after interactions to analyze display content for functionality verification. The main innovations of our project include a mechanical system that integrates a robotic arm with a sliding table, ensuring adaptability to various screen sizes and in-vehicle testing scenarios. The development of this automated test tool aims to raise the automation level of testing for vehicle infotainment systems and puts the performance and accuracy at highest priority so that it can meet the standards required in modern vehicles.
