rogue tagged posts

Engineering researcher seeks to prevent AI agents from going rogue

AI agents
Credit: Unsplash/CC0 Public Domain

As artificial intelligence systems become increasingly capable of working on their own, keeping them focused on their designated tasks is a growing challenge.

University of Florida computer science professor Sumit Jha, Ph.D., is working to keep agents from “going rogue.” Jha and his team have developed a system that can detect when an AI model begins to from its assigned task and steer it back without retraining the model or adding significant computing demands.

The research comes as news reports have chronicled AI agents gaining more autonomy and occasionally behaving in ways their developers did not intend...

Read More