Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Description

Marengo is an advanced multimodal model designed to convert video, audio, images, and text into cohesive embeddings, facilitating versatile “any-to-any” capabilities for searching, retrieving, classifying, and analyzing extensive video and multimedia collections. By harmonizing visual frames that capture both spatial and temporal elements with audio components—such as speech, background sounds, and music—and incorporating textual elements like subtitles and metadata, Marengo crafts a comprehensive, multidimensional depiction of each media asset. With its sophisticated embedding framework, Marengo is equipped to handle a variety of demanding tasks, including diverse types of searches (such as text-to-video and video-to-audio), semantic content exploration, anomaly detection, hybrid searching, clustering, and recommendations based on similarity. Recent iterations have enhanced the model with multi-vector embeddings that distinguish between appearance, motion, and audio/text characteristics, leading to marked improvements in both accuracy and contextual understanding, particularly for intricate or lengthy content. This evolution not only enriches the user experience but also broadens the potential applications of the model in various multimedia industries.

Description

VideoPoet is an innovative modeling technique that transforms any autoregressive language model or large language model (LLM) into an effective video generator. It comprises several straightforward components. An autoregressive language model is trained across multiple modalities—video, image, audio, and text—to predict the subsequent video or audio token in a sequence. The training framework for the LLM incorporates a range of multimodal generative learning objectives, such as text-to-video, text-to-image, image-to-video, video frame continuation, inpainting and outpainting of videos, video stylization, and video-to-audio conversion. Additionally, these tasks can be combined to enhance zero-shot capabilities. This straightforward approach demonstrates that language models are capable of generating and editing videos with impressive temporal coherence, showcasing the potential for advanced multimedia applications. As a result, VideoPoet opens up exciting possibilities for creative expression and automated content creation.

API Access

Has API

API Access

Has API

Screenshots View All

Screenshots View All

Integrations

TwelveLabs

Integrations

TwelveLabs

Pricing Details

$0.042 per minute
Free Trial
Free Version

Pricing Details

No price information available.
Free Trial
Free Version

Deployment

Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook

Deployment

Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook

Customer Support

Business Hours
Live Rep (24/7)
Online Support

Customer Support

Business Hours
Live Rep (24/7)
Online Support

Types of Training

Training Docs
Webinars
Live Training (Online)
In Person

Types of Training

Training Docs
Webinars
Live Training (Online)
In Person

Vendor Details

Company Name

TwelveLabs

Founded

2021

Country

United States

Website

www.twelvelabs.io/product/models-overview#marengo

Vendor Details

Company Name

Google

Website

sites.research.google/videopoet/

Product Features

Alternatives

Alternatives

VideoPoet Reviews

VideoPoet

Google
Wan2.1 Reviews

Wan2.1

Alibaba
Marengo Reviews

Marengo

TwelveLabs