Researchers from the Texas A&M University College of Engineering and the Korea Advanced Institute of Science and Technology have introduced a new artificial intelligence (AI) system called OmniPredict, designed to improve safety for self-driving cars.
OmniPredict is the first system to use a Multimodal Large Language Model (MLLM) to forecast how pedestrians may behave. It draws on the same kind of underlying technology used in advanced chatbots and image recognition, but its goal is different. By pairing what it sees with contextual details, the system aims to predict, in real time, what a person is likely to do next.
Early testing has attracted attention, indicating that OmniPredict can deliver notably high accuracy even without specialized training.
“Cities are unpredictable. Pedestrians can be unpredictable,” said Dr. Srinkanth Saripalli, the project’s lead researcher and director of the Center for Autonomous Vehicles and Sensor Systems. “Our new model is a glimpse into a future where machines don’t just see what’s happening, they anticipate what humans are likely to do, too.”
To read more, click here.