Cutting Edge Cloud Technology teamed with Newsbridge’s Signature Multimodal Cognitive AI

How Newsbridge’s collaboration with AWS led to one of Europe’s leading and most powerful transcription, cognitive-indexing MAM solutions. 

About Newsbridge 

Co-founded in 2016 by brothers Frédéric and Philippe Petitpont in Boulogne-Billancourt, France, Newsbridge is a cloud-based, AI-powered MAM platform for production teams. Leveraging its smart digital asset management via facial, object and language analysis, the Newsbridge platform offers journalists, production companies and rights holders immediate and auto-organized access to their most relevant content.

By bringing together artificial intelligence, cognitive technologies and extensive broadcast expertise, Newsbridge is revolutionizing the video production and editing processes for advanced and real-time story production via an automated media logging solution, processing several thousand hours of content each month for the largest European publishers, television channels (M6 Group, TF1 Group) and sports rights holders (adidas, Evian Championship or French Rugby Federation).

 Brothers Philippe and Frederic Petitpont  co-founded Newsbridge in 2016.

Context: Production Team Challenges

Each day, production teams consolidate and upload mass amounts of content to digital databases which then needs to be analyzed by human beings. From categorizing assets to identifying sources, scenes, themes, locations, personalities, etc. the job is becoming an increasingly demanding task with little room for error.

Additionally, publishing time continues to be a production challenge, as time is money in the industry. Most news outlets prioritize what is hot off the press, with journalists who take their time fact-checking and understanding material often left in the dust. Instead, newsrooms take quickly populated and not-so-relevant stories, resulting in lower quality deliverables. 

Having a background in broadcast engineering and computer science with a shared mission to enhance advanced story production via smart digital asset management, the Petitpont brothers had a revolutionary idea, and soon-after the Newsbridge platform was conceived.  

In front of a selection jury, Newsbridge was selected to join the accelerator program with France Televisions.

With a core objective of expediting the post-production process resulting in lightning-speed with near-live publish times (with cut costs as an added bonus), Newsbridge’s AI-Based video indexing MAM platform leverages both Newsbridge AI technology and the scaling capacity of AWS computing infrastructures. Such technology includes but is not limited to: facial recognition, object detection, speech-to-text and context analysis. Unique to competitors, Newsbridge is an all-in-one digital asset management platform that smartly indexes assets in real-time (compared to a simplistic transcription or digital asset storage services).

-Frédéric Petitpont, Newsbridge CTO and Co-founder

The Newsbridge Platform 

At Newsbridge, user experience and product quality are paramount. With a designated UX department and expert collaboration with Amazon Web Services, harnessing the elements of platform design and high-level functionality is a strong suit within the organization. From the beginning, these two components were prioritized as the core value of Newsbridge’s AI-powered platform lies in the simplification of the advanced investigation process.

A look at Newsbridge’s Cognitive Search Feature, showcasing how certain labels can be used in the search bar to instantly find people, places and statements from uploaded assets.

In order to make this objective a reality, the Newsbridge platform has been designed to include an array of proprietary, complex and powerful, existing datasets. These data sets are part of a big data framework which the Newsbridge team has adapted for video, with microservices at an infinite scale. 

An Expert Solution Paired with Expert Collaboration

With the added-value of Amazon expertise, Newsbridge uses its signature multimodal cognitive AI technology in collaboration with the following AWS capabilities to carry-out the smart-indexing of hundreds of thousands of digital media assets in real-time, using a variety of microservice algorithms. 

o   Amazon EC2 G4 Instances run neural networks and machine learning applications to train and detect patterns from custom datasets imported by customers. Newsbridge is able to harness the power of Nvidia GPU and the very latest instances g4dn to cut costs and compute advanced multimodal inferences (crossing transcription, patterns, facial and object recognition to achieve an improved confidence level).

o   Amazon Comprehend detects named entities to boost relevancy for multimodal analysis purposes. Using natural language processing (NLP), this algorithm develops insight via entity, key phrase, language and sentiment recognition. Comprehend’s key phrase detection matches keywords relevant to an article against existing Brightspot instance tags, offering advanced suggestions to users. 

Why did Newsbridge decide to collaborate with AWS? 

Newsbridge decided to initiate collaboration with AWS for several reasons. First, Amazon Web Services are highly available, flexible and scalable as applied to our infrastructure.

Next, state-of-the-art technologies are also able to operate with and power a multitude of components. 

Additionally, autonomy was another factor. Amazon’s “everything available + self service” policy was the kind of service we wanted, as it’s aligned with our foundational objective of empowering journalists, editors and rights holders with their media.

Finally Transparency, certifications available on demand as compliance and privacy are not a selling point but a prime requirement for Newsbridge and one of the ingredients of trust with our clients.

What does that look like?  

As previously mentioned, the Newsbridge platform is a (very) smart digital asset management system with advanced yet secure organizational indexing capabilities.

To give you a clear idea, once a user logs into the platform he or she lands on the homepage dashboard, in which a centralized cognitive search bar can be found at the top of the screen, with mission streams organized by AI below.

In order to populate these streams, users are able to create a live or file-based mission and then select the outbound destination. Once the mission is created, the platform immediately and automatically analyzes, and indexes the given media asset. 

For a more visual representation of the Newsbridge search bar function, please see below:

An example of the Newsbridge cognitive search bar in action! A user is able to find the following indexed excerpt from a library of 1.5 million media assets (videos, images, etc.) via searching relevant keywords.

Newsbridge Cloud Solutions at Work 

To implement the components of Newsbridge Platform, the initiative was spearheaded with several implementation phases and a combination of AWS Cloud Services along with proprietary Newsbridge Cognitive AI with several open source integrations.

AWS EC2 G4 Instances

AWS EC2 G4 Instances is the infrastructure used to perform user’s custom pattern recognition and multimodal inferences over live streams and video files. 

This infrastructure works by taking a heavy video file or live stream which needs indexed, and processing it through a network of multimodal actors (we could see these as autonomous microservices) which can range from speech-to-text to facial recognition for example- creating an output of video material that is compressed, smartly indexed and stored. 

The system orchestrating each AI component is called Akka, implemented using the Scala language, which helps each microservice work with or “communicate” with the others. This technology is especially helpful when dealing with a very high number of threads in parallel, as it creates an actor system disptached over a cluster of instances. Instances are set in an EC2 autoscaling group to ensure every task is processed faster than real time. Cognitive analysis performed like this is way more efficient than a traditional sequential linear model (without multimodal analysis capabilities) that can often be hardwared-capped when deployed on-prem – it is actually the only way to have multimodal cognitive analysis done live for a virtually unlimited amount of streams. This saves producers time and money along with creating extreme asset value and freshness.

Amazon Comprehend 

AWS Comprehend crosses data contextually to boost confidence levels. It takes unformatted, written blocks and adds structure and context via NLP (natural language processing) databases and technology. In relation to AWS EC2 G4 Instances mesh network, Amazon Comprehend is just one of the microservice algorithms.

Outcome

Through the unique cloud-based infrastructure on AWS, the Newsbridge Platform enables production teams to quickly, smartly and accurately index and manage their digital media assets. This has resulted in accelerated digital media asset management for numerous production teams in an array of industries. Additionally, the customizability and agility of the platform provides to the storytelling community the ability to quickly and efficiently search for, analyze and categorize assets via a real-time solution, based on their self-populated, complete pool of assets.

The result is an off-the shelf, comprehensive solution that adds clear value to story-tellers and producers world-wide.

Amazon Web Services remains a trusted provider, as Newsbridge will harness AWS’ worldwide locations and availability to deliver services close to its international clients’ offices.