In case you missed it, Claude will now be able to use computer tools like humans. Developers will be able to use it to automate repetitive processes and conduct research. Claude will now be able to translate prompts into computer commands.
We’ve built an API that allows Claude to perceive and interact with computer interfaces.
This API enables Claude to translate prompts into computer commands. Developers can use it to automate repetitive tasks, conduct testing and QA, and perform open-ended research. pic.twitter.com/eK0UCGEozm
— Anthropic (@AnthropicAI) October 22, 2024
For example, you can use Claude to open a new Chrome window, navigate to claude.ai and create a website. Incredibly, Claude interacts with itself to complete the task. It can download the file, open VS Code, and load the file. It can even start a server. In the future, Claude will be able to do all of this with even fewer prompts.
We’ve built an API that allows Claude to perceive and interact with computer interfaces.
This API enables Claude to translate prompts into computer commands. Developers can use it to automate repetitive tasks, conduct testing and QA, and perform open-ended research. pic.twitter.com/eK0UCGEozm
— Anthropic (@AnthropicAI) October 22, 2024
In other demos, researchers demonstrated how Claude can interact with Google Calendar. Pretty incredible if you ask us. This is going to be quite a game changer, don’t you think?
[HT]
