AI

Anthropic’s New Hardware Standard Lets AI Agents Control Physical World

Anthropic is coming up with a new hardware that changes the seeming traditional interest in and uptake of agentic AI systems over the past years.

The world of automated AI has thus far been primarily limited to text, images, code, and other data and actions that take place inside a computer, but Anthropic says with what its Model Hardware Standard (MHS), a set of standardised drivers designed to let AI agents easily interface with and control arbitrary devices.

For now, the “research preview” of the MHS effort is being sold mainly as a way to help scientists streamline the arduous process of creating the custom software integrations that are often needed to get disparate components of an experiment working in concert.

MHS can provide a common interface and common format for data sharing between these devices, Anthropic says, allowing them to talk to each other across a network “without needing a bespoke ‘translator’ program in between.”

The standardised system could reduce weeks or months of exacting experimental setup down to “hours or minutes,” Anthropic announced.

In a video posted alongside the announcement, Anthropic Technical official, Alek Kemeny says the MHS effort was inspired by observing neuroscientist Arco Bast work through an experiment on memory formation in the brain at the HHMI Janelia Research Campus in Ashburn, Virginia.

Kemeny said Bast had worked out an interface to get the rotating laser beams, microscopes, cameras, and myriad other components of the experiment to coordinate through a common interface. “This idea could be used to have AI run any science experiment in the world,” Kemeny recalls thinking at the time.

According to the company, there’s nothing about a common machine interface language that requires the use of AI models. And Anthropic says MHS devices can be controlled directly in real time via command-line prompts and API code files. But integrating an MHS system with an AI model through the Model Context Protocol lets scientists interact with devices using natural language and lets models “reason through each step in an experiment, update parameters in real time, and, in some cases, recover from hardware errors without intervention.”

Anthropic gave the example of a model like Claude adjusting a laser, checking the results via a separate camera, then repeating the process to automatically calibrate the whole system. MHS could also allow an AI model to focus a microscope, analyse the results, decide what part needs more observation, then automatically move the microscope to the relevant section to continue the experiment.

In a video, Anthropic also showed Claude reasoning how to get a robotic arm to pick up an aluminum even though it had not been specifically trained on the required steps. And rather than reasoning through each step each time, Anthropic says MHS-enabled models can sequence steps across instruments by writing API scripts and adjusting them as conditions require.

The artificial intelligence (AI) company said MHS also includes a standardised tagging system to describe hardware’s real-world constraints for models that may have been trained more in the virtual world. That includes encoded information about the hardware’s physical characteristics (e.g., the weight and range of a robot arm) as well as its adjustable parameters, measurement options, and enforced safety limits. These tags can then be integrated into a reference file that can quickly provide an AI model with crucial information about a device it has no previous training experience with.

For now, Anthropic said it is working with “a first group of scientific research labs and advanced manufacturers” during an MHS preview period, including Amazon Web Services (Strands Robots), Hugging Face (LeRobot), Raspberry Pi, Automata, and Universal Robots.

These partners will help Anthropic “build safety evaluations and develop best practices for AI systems operating physical equipment,” the company writes. After that, the plan is for MHS to eventually become an open source and “agent agnostic” standard for integrating AI and physical systems.

In early testing with scientific partners over the past year, the company said it “saw MHS reduce the time it took to integrate devices, mak[ing] it possible to iterate faster in a variety of experimental settings.

“If you can test hypotheses faster, you could create general technologies faster,” Kemeny said in a promo video alongside the announcement.

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button