Claude 3.5 Sonnet, which anthropopic announced as part of the larger Claude 3.5 family—which will be completed later this year with the release of Claude 3.5 Haiku and Claude 3.5 Opus—brings some serious competition to GPT-4o and Gemini 1.5 Pro. Not only does Claude 3.5 Sonnet beat GPT-4o and Gemini 1.5 Pro in several benchmarks, but it also introduces a new awesome feature called Artifacts.
At Google, we love to break down the newest AI news; if you'd like to read more about recent developments, I suggest these articles:
I’m excited to show you how cool the Artifacts feature is, so let’s begin!
Claude 3.5 Sonnet: First Impressions
I was intrigued by the benchmark results, so I went straight to Claude.ai to test the new Claude 3.5 Sonnet model.
I first asked Claude 3.5 Sonnet to create a graph using the data in the table below:
I reckon I didn’t put much thinking effort into the prompt I used—Generate a graph for this table—and yet the model generated this interactive grouped bar chart:
Claude 3.5 Sonnet implemented the chart as a React component using the Recharts library. We can see and copy the code by switching to the Code tab from the top right corner:
The generated bar chart's color legend at the bottom overlapping with the x-axis labels is one issue that disturbed me. Aside from that, one graph simply cannot contain all the information. I suggested Claude 3.5 Sonnet to create a unique infographic for each benchmark because I felt it would be an interesting idea:
Create an infographic for the code benchmark that includes a brief description of the benchmark's objectives and a side comparison graph that displays each LLM's score on the benchmark.
Considering how poor my prompt was, I must admit that the outcome was really impressive:
The infographic has a nice selection of colors and font characteristics, and it is well-organized. I can already think of a ton of uses for this—for example, we might add brand-specific tweaks and modify the design to suit our needs with careful prompting.
If you haven't used Claude 3.5 Sonnet yet, you may be curious about the UI element that displays the code in addition to the graph. Go to Artifacts.
Artifacts: Claude AI’s New Feature
There’s no point in me explaining what Artifacts are when the official video does it so much better. The reason I encourage you to watch this is because they show how to create a side-scrolling game in HTML 5 in one minute:
Artifacts feel so dynamic!
And what excites me is Antrophic’s promise to design it for team collaboration:
It’s just the beginning of a broader vision for Claude.ai, which will soon expand to support team collaboration. In the near future, teams—and eventually entire organizations—will be able to securely centralize their knowledge, documents, and ongoing work in one shared space, with Claude serving as an on-demand teammate.
Anthropic AI
How to Access Claude 3.5 Sonnet
The most straightforward way to access Claude 3.5 Sonnet is to go to Claude.ai and have fun in their friendly graphical user interface:
Claude 3.5 Sonnet is free to use on Claude.ai, but I do need to mention that I reached usage limits very quickly (after about ten prompts).
If you want to use Claude 3.5 Sonnet regularly, there’s no doubt that you’ll need to buy a Pro subscription.
Claude 3.5 Sonnet is also available via the Anthropic API, Google Cloud’s Vertex AI, and Amazon Bedrock.
Price Comparison: Sonnet vs. GPT-4o vs. Gemini Pro 1.5
Since I brought up Antrophic’s API, let’s look at how the prices compare to those of OpenAI and Google. Of course, this is a good opportunity to ask Claude 3.5 Sonnet to create a graph:
For personal use, all three platforms charge about $20/month.
Claude 3.5 Sonnet Use Cases
It should come as no surprise that Claude 3.5 Sonnet, Anthropic's best vision model, does so well on tasks requiring visual reasoning, like as reading and generating graphs. But it's also touted as a fantastic writing or coding companion, so let's investigate further.
Visual presentations
Claude 3.5 Sonnet appears to be able to do some serious magic if you have data that needs to be presented visually.
In Anthropic's example, a biology professor presents two graphs to the model and instructs Claude to extract pertinent data so that the model can be used to produce a Javascript-based presentation using reveal-js, a well-liked framework for HTML presentation creation. Check to see if the lecturer received the slides she requested:
Coding partner
Let’s say you’re a software engineer who tries to write tests and fix bugs in a code that crops images into circles (so users can have nice profile images). Can Claude 3.5 Sonnet help with that? Let’s see:
Writing partner
Anthropic also showcases Claude 3.5 Sonnet as a writing partner, but their example couldn’t be further from a real-world use case—novels are generally not about “sarcasm-laden crabs that live on bustling reefs.” The genogram Claude creates is awesome, though, and once again showcases its amazing visual abilities.
Conclusion
It's been difficult to get enthusiastic about new releases in the AI sector over the past several years because there have been so many news stories and achievements in the field—especially with so many demonstration films that feature only a select few examples.
On the other hand, Claude 3.5 Sonnet's graphic capabilities and Artifacts feature really thrill me. Personally, I'll give it a go for work and monitor its advancement.
0 Comments: