Video AI: Gemini’s Game

An increasing number of AI models are being developed as multimodal, with models like Google’s Gemini 1.5 Pro reportedly supporting video capabilities.

To evaluate a multimodal model’s video capabilities, consider using the following two simple prompts as test cases:

1. Write a clear, step-by-step description of the gaming video, assuming the viewer has zero experience with video games, to help them understand what’s happening on screen.
2. In the video featuring the tiger called “Tiger Vanguard”, what actions or strategies can be taken to avoid his attacks, specifically his punches?

Test Case

Write a clear, step-by-step description of the gaming video, assuming the viewer has zero experience with video games, to help them understand what’s happening on screen.

Gemini-1.5-Pro-Experimental-0827:

Okay, here’s a step-by-step description of the gaming video:

1. Scene: The game shows a large, red pool of liquid, possibly blood, within a ruined stone structure.

2. Characters: There are two characters:

– A large, bear-like creature with a sword on its back, standing in the red pool.
– A smaller, human-like character, also in the pool, wielding a staff-like weapon.

1. Action:

– The smaller character moves through the red pool, attempting to attack the bear-like creature.
– The bear-like creature charges toward the smaller character.
– The smaller character dodges the charge, causing the bear-like creature to stumble and fall momentarily.

1. Health/Status:

– In the bottom left corner, there are bars representing the smaller character’s health and other resources, possibly stamina or magic.
– Similar indicators for the bear-like creature are likely present, but not clearly visible in this clip.

1. Interface:

– Icons and text in the corners of the screen represent in-game items, abilities, or objectives relevant to the player controlling the smaller character.

In simple terms: The video shows a fight between a human-like character and a large bear-like monster in a pool of red liquid. The human character is trying to defeat the monster using a staff-like weapon. The screen also shows information about the human character’s health and other resources, as well as some in-game options and objectives.

Essentially, the player controlling the smaller character is navigating a challenging encounter within the game world. They must utilize their skills and resources to overcome the bear-like opponent and progress further.

The large bear-like monster is called “Tiger Vanguard”. In the video featuring the tiger called “Tiger Vanguard”, what actions or strategies can be taken to avoid his attacks, specifically his punches?

Gemini-1.5-Pro-Experimental-0827:

Based on the short clip, here are some possible actions and strategies to avoid Tiger Vanguard’s punches in the game:

1. Dodging:

• Lateral Dodge: As seen in the clip, quickly moving to the side (left or right) as Tiger Vanguard begins his punch animation can be effective. Timing is crucial.
• Backwards Dodge: If there’s enough space, a quick step or roll backward might also help evade the attack.

2. Utilizing the Environment:

• Obstacles: If possible, positioning yourself behind pillars or other elements of the environment could block or disrupt Tiger Vanguard’s punch.
• Water: The water itself might offer a slight advantage for movement and dodging compared to fighting on solid ground.

3. Observing Attack Patterns:

• Telegraphing: Like many enemies in action games, Tiger Vanguard might have specific animations or cues before launching an attack. Learning to recognize these “tells” can give you a split-second advantage to react.
• Attack Chains: Pay attention to whether his punches come in combos or sequences. If he tends to follow up with a second or third attack, anticipate it and be ready to dodge multiple times.

4. Using Abilities (Speculation):

• Parry/Counter: Many action games have mechanics that allow for parrying or countering enemy attacks. If the game features such a system, mastering it could be crucial for dealing with Tiger Vanguard’s punches.
• Special Moves: The game might have special moves or abilities that grant temporary invulnerability, allow for quick dashes, or create distance, all of which could be useful for evasion.

Important Notes:

• This analysis is based on a very short clip. A full understanding of Tiger Vanguard’s moveset and optimal strategies would require more extensive gameplay experience.
• The game’s specific mechanics and the player’s chosen build (character stats and skills) will influence which evasion techniques are most effective.

By practicing these strategies and learning Tiger Vanguard’s patterns, players can increase their chances of successfully dodging his powerful punches and surviving the encounter.

Video AI on Video

@bluebirdback

Imagine an AI that can: 👵 Explain your epic boss battle to grandma 🐅 Coach you to dodge Tiger Vanguard’s punches Google’s Gemini 1.5 Pro is doing it ALL! 🤖🔥 It doesn’t just read – it WATCHES and LEARNS from videos! 👀 Are you ready for an AI gaming buddy that actually gets your gameplay? 🤯 Comment 🎮 if you’re hyped to test this beast! #AIGaming #FutureIsCrazy #GeminiAI #BlackMythWukong #TigerVanguard

♬ original sound – BlueBirdBack – BlueBirdBack

View this post on Instagram

A post shared by BlueBirdBack (@backbluebird)