LLM tagged posts

Engineering researcher seeks to prevent AI agents from going rogue

AI agents
Credit: Unsplash/CC0 Public Domain

As artificial intelligence systems become increasingly capable of working on their own, keeping them focused on their designated tasks is a growing challenge.

University of Florida computer science professor Sumit Jha, Ph.D., is working to keep agents from “going rogue.” Jha and his team have developed a system that can detect when an AI model begins to from its assigned task and steer it back without retraining the model or adding significant computing demands.

The research comes as news reports have chronicled AI agents gaining more autonomy and occasionally behaving in ways their developers did not intend...

Read More

AI agents are all the rage—but research shows they leak private data

AI agents are all the rage—but research shows they leak private data
A real-world credential leakage case discovered in the study. The developer embedded a Base64-encoded client secret directly in the skill’s source code, exposing the credential to anyone who installs or inspects the skill. Credit: arXiv (2026). DOI: 10.48550/arxiv.2604.03070

Before you prompt AI to answer another question or perform another task, a Wake Forest computer scientist wants you to know it could expose your sensitive data.

Ying Zhang, an assistant professor in Wake Forest University’s Department of Computer Science, studies security in software engineering. Her latest research, “How Your Credentials Are Leaked by LLM Agent Skills,” explores how large language model (LLM) agents make data vulnerable to attacks.

LLM agents are autonomous AI systems that analyze circum...

Read More

Hidden prompts can plant false memories in AI agents, researchers warn

Study exposes security risks of AI agents with long-term memories
Stateless LLM agents process each interaction in isolation. LLM agents with persistent memory allow for querying and retrieving saved information. Credit: Torres, Shrestha & Misra.

Large language models (LLMs), the computational algorithms underpinning ChatGPT, Gemini and other artificial intelligence (AI)-powered conversational platforms, are now widely used worldwide. These models can rapidly answer questions, source information online, assist users with specific tasks and produce text tailored for specific purposes.

Over the past few years, computer scientists have introduced a wide range of LLMs, some of which can also complete tasks autonomously and take actions on a user’s behalf, for instance, answering messages, scheduling online appointments or updating programming code...

Read More

Researchers develop ‘hierarchical AI agent’ that tackles complex errands with ease

ETRI develops
Hierarchical AI Agent. Credit: Electronics and Telecommunications Research Institute (ETRI)

Korean researchers have developed a hierarchical AI technology that autonomously plans even complex, long-horizon tasks. The development of this hierarchical task-planning AI technology, which reduces hallucinations and doubles the success rate, is expected to help robots and agents carry out long-term missions.

The Electronics and Telecommunications Research Institute (ETRI) developed the hierarchical task-planning artificial intelligence (AI) technology “ReAcTree,” which autonomously divides tasks requiring complex and lengthy procedures into subgoals and carries them out, and presented it at AAMAS 2026, one of the world’s premier conferences in the AI agent field.

This research achievem...

Read More