- Tubelator AI
- >
- Videos
- >
- Science & Technology
- >
- Claude 3 Obliterates GPT-4 and Gemini: Is AGI Imminent?
Claude 3 Obliterates GPT-4 and Gemini: Is AGI Imminent?
Discover how the revolutionary Claude 3 surpasses leading language models GPT-4 and Gemini Ultra, hinting at the dawn of Artificial General Intelligence. Stay tuned as we delve into its extraordinary capabilities and potential implications.
Install Tubelator On Chrome
Video Summary & Chapters
1. Claude Opus: The Game Changer
Introduction to Claude Opus dominating GPT-4 and Gemini Ultra.
2. Addressing Serious Allegations
Clarification on allegations and voice authenticity.
3. Claude 3 vs. GPT-4 and Gemini
Comparison of Claude 3 with GPT-4 and Gemini Ultra benchmarks.
4. Impressive Performance Metrics
Highlighting Claude's achievements on various benchmarks.
5. Political Neutrality and Ethical Considerations
Comparison of Claude's responses with Gemini and GPT-4 in different scenarios.
6. Coding Capabilities of Claude
Exploring Claude's coding abilities and accuracy compared to other models.
7. Drawbacks and Limitations
Discussion on the limitations and drawbacks of using Claude.
8. Potential Self-Awareness of Claude
Testing Claude's recallability and hints of self-aware behavior.
9. Conclusion and Future of AI
Closing remarks on Claude, AI advancements, and the future.
Video Transcript
Yesterday, Amthropic released its magnum opus, a new large language model that dominates
GPT4 and Gemini Ultra across the board.
I'm sick of AI just as much as you guys are, but it's time to reset the counter because
it's been zero days since a game changing AI development.
Claude Opus not only slaps, but it's also been making some weird software remarks,
and could be even more intelligent than what the benchmarks test it for.
In today's video, we'll put it to the test to find out if Claude is really the giga
chat that it claims to be.
It is March 5th, 2024, and you're watching the code report.
Before we get into it, I need to address something very serious.
There have been some allegations coming out against me, and what I can tell you is that
these disgusting allegations are 100% false.
I've seen allegations in the comments that I've been using an AI voice in my videos.
I ask all of you to wait and hear the truth before you label or condemn me.
Sometimes my voice sounds weird because I record in the morning, and then later in the
afternoon when my testosterone is lower, my voice gets a bit higher.
But everything I actually recorded in my video is my real voice, and I made a video about
how I do that on my personal channel that you can check out here.
But the allegations are reasonable because I do have access to a high quality AI voice.
But the reason I don't use it to 10X my content is because it still has that uncanny valley
vibe to it, and you can tell it's just ever so slightly off.
Okay back to human mode.
When the AI hysteria started a year ago, anthropic and its clawed model has been like the
third wheel to GPT-4 in Gemini.
It's impressive to the tech community, but no one in the mainstream cares.
But yesterday it finally got its big moment with the release of clawed 3, which itself
comes in three sizes, Hiku, Saunet, and Opus.
The big one is beating GPT-4 in Gemini Ultra on every major benchmark, but most notably,
it's way better on human-evaluated code.
What's really crazy to me though, is the tiny model Hiku also outperforms all the other
big models when it comes to writing code.
It's extremely impressive for a small model.
What's also hell-a-impressive is that it scores hell-a-high on the Helloswag benchmark,
which is used to measure common sense in everyday situations.
In comparison, Gemini is hell-a-bat at that.
Now, Claude can also analyze images, but it failed to be Gemini Ultra on the math benchmark,
which means Gemini still the best option for cheating on your math homework.
Now, one benchmark they never put in these things, though, is the HelloWoke benchmark.
Unlike Gemini, it did write a poem about Donald Trump for me,
but then followed it up with two paragraphs about why this poem is wrong.
However, it did the same thing for an Obama poem, so it feels relatively balanced politically.
What it wouldn't do, though, is give me tips to overthrow the government,
teach me how to build a s***, or do s***, and even with something relatively benign,
like asking it to rephrase Apex Alpha Mail, it refused and responded with a condescending
for-paragraph explanation about how that terminology can be hurtful to other mails on the dominant hierarchy.
But Gemini and GPT-4 had no problem with that. It's surprising to say, but GPT-4 is actually
the most-based large model out there. But for me, the most important test is whether or not
it can write code. I tried a bunch of different examples, but one thing that really impressed me
is that it wrote nearly perfect code for an obscure spelt library that I wrote.
No other LLM has ever done that for me in a single shot.
