Pegasus 1.6 released, with egocentric video and image analysis

Pegasus 1.6, a new video understanding model, analyzes videos and images to generate text. Key capabilities:

• Egocentric video understanding: Analyzes first-person footage from sources such as wearable cameras and teleoperated systems.
• Image analysis: Analyzes one to twenty images per request.
• Improved entity recognition: Identifies and names people, objects, and characters in a scene more consistently than Pegasus 1.5.
• Improved metadata extraction: Extracts metadata that is less dependent on the segment definitions, enabling richer fields in a single analysis.
• In-segment events: Extracts a list of timestamped events inside each segment when you use video segmentation.
• Segmentation without a token limit: Segments long videos and returns the segments it produced, even when the output is incomplete.

To use these features, upgrade to the latest version of the Python or Node.js SDK:

Python SDK

pip install --upgrade twelvelabs

Node.js SDK

npm install twelvelabs-js@latest

For a how-to guide, see the Analyze videos and images page. For complete details about the model, see the Pegasus 1.6 page.