HACKINTOSH.ORG | Macintosh discussion forums

Anthropic is letting Claude AI control your PC

<p>Anthropic's latest development gives its Claude AI assistant the ability to control a PC, reportedly just like a person would. The feature, dubbed 'computer use,' entered public beta today. With computer use, Claude can be directed to execute tasks such as &quot;looking at a screen, moving a cursor, clicking buttons, and typing text,&quot; according to the company's <a data-i13n="cpos:1;pos:1" href="https://www.anthropic.com/news/3-5-models-and-computer-use">announcement[/url].&nbsp;</p>
<div id="92b8447c4b4b408e93cfa74acd232c5e"><blockquote class="twitter-tweet"><p lang="en" dir="ltr">We've built an API that allows Claude to perceive and interact with computer interfaces.

This API enables Claude to translate prompts into computer commands. Developers can use it to automate repetitive tasks, conduct testing and QA, and perform open-ended research. pic.twitter.com/eK0UCGEozm (https://t.co/eK0UCGEozm)</p>— Anthropic (@AnthropicAI) October 22, 2024 (https://twitter.com/AnthropicAI/status/1848742752403476488?ref_src=twsrc%5Etfw) </div>
<p>In theory, this could make the AI even more useful in automating repetitive computer tasks. However, a second <a data-i13n="cpos:2;pos:1" href="https://www.anthropic.com/news/developing-computer-use">blog post[/url] focused on computer use acknowledged that this application of Anthropic's AI models is still early in development and, to paraphrase, buggy as heck. The company said that in internal testing, Claude stopped in the middle of an assigned coding task and began opening images of Yellowstone National Park. While that is uncannily human behavior (who doesn't want to take a break to stare at natural beauty during the work day?), it's also a reminder that even the best AI models can have errors.</p>
<span id="end-legacy-contents"></span><p>In addition to unveiling computer use, Anthropic also released an upgraded version of its <a data-i13n="cpos:3;pos:1" href="https://www.engadget.com/anthropics-newest-claude-chatbot-beats-openais-gpt-4o-in-some-benchmarks-170135962.html">Claude 3.5 Sonnet[/url] model alongside a brand new model called Claude 3.5 Haiku that will be released later in October. In August, Anthropic joined OpenAI in <a data-i13n="cpos:4;pos:1" href="https://www.engadget.com/ai/openai-and-anthropic-agree-to-share-their-models-with-the-us-ai-safety-institute-191440093.html">agreeing[/url] to share its work with the US AI Safety Institute.</p>This article originally appeared on Engadget at https://www.engadget.com/ai/anthropic-is-letting-claude-ai-control-your-pc-181500127.html?src=rss

Source: Anthropic is letting Claude AI control your PC (https://www.engadget.com/ai/anthropic-is-letting-claude-ai-control-your-pc-181500127.html?src=rss)