Delivering Live Broadcasts and Playout with AWS: How 2nd Watch Can Help
Live broadcasts and playouts are critical requirements for media companies to satisfy their audiences. More customers are cutting cords and watching live channels on the web, mobile, tablets, and smart TVs. As a result, media companies are pressured to bring additional channels to market and scale up their delivery capabilities.
Amazon Web Services (AWS) is a solution for media companies to deliver live broadcasts and playouts. AWS offers various services to help media companies design, build, and manage a scalable, reliable, cost-effective live broadcast and playout solution. These services include AWS Elemental MediaLive, a real-time video encoding service; AWS CloudFront, a content delivery network (CDN); and AWS MediaConnect, a transport service for live video streams. In addition, partnerships with leading media and entertainment technology companies – such as Amagi, BCNEXXT, Grass Valley, and Imagine Communications – can provide expertise and support in implementing and managing a live broadcast and playout solution on AWS.
Here is an example Terraform template that creates a MediaLive channel that receives an SRT input and outputs HLS to CloudFront:
This template creates a MediaLive channel with an SRT input and an HLS output. The HLS output is written to an S3 bucket, and a CloudFront distribution is created to serve the HLS output to users.
This is an example: you will need to customize it for your specific use case. For instance, you must specify the SRT input settings, such as the IP address and port of the SRT source. You must also specify the details of the S3 bucket and CloudFront distribution.
2nd Watch is an experienced AWS partner with the knowledge and resources to support media companies in designing, building, and managing an effective live broadcast and playout solution on AWS. Our team is familiar with a range of AWS services, including AWS Elemental MediaLive, AWS CloudFront, and AWS MediaConnect, as well as partnerships with leading media and entertainment technology companies. Contact us today to learn more about our consulting services for live broadcast and playout on AWS.
Technical Overview of Migrating Media Company Assets to AWS S3
As media companies grow, they accumulate large amounts of old tapes and undigitized video in their warehouses. These assets can be valuable, but they are difficult to access and monetize in their current form. Moreover, storing these assets in warehouses is risky and costly.
Media enterprises can address these problems by migrating their assets to cloud storage, specifically Amazon Web Services’ Simple Storage Service (S3). S3 is a scalable, durable, and secure object storage service that can store and retrieve any amount of data anywhere on the web. By migrating the assets to S3, media companies can reduce the risk to their business, lower the cost of storing and accessing the assets, and increase revenue generation.
Once the assets are migrated to S3, they can be processed using a pipeline to transcode the video, extract metadata, and make the archive searchable. The extracted metadata can be used to integrate the assets with existing systems, making it easier for editors to access and use.
The following code sample shows how to extract metadata from video assets stored on AWS S3 using Node.js and the AWS SDK. The metadata is extracted using the AWS Elastic Transcoder, and the resulting metadata is saved to both Amazon DynamoDB and Amazon OpenSearch.
This code sample shows how to extract metadata from video assets stored on S3 using the AWS Elastic Transcoder. The metadata is then saved to DynamoDB and OpenSearch for further processing and querying. This code can be modified to support different file formats, metadata extraction techniques, and storage options.
Migrating media assets to S3 is a technical solution that can provide numerous benefits. It can reduce the risk to the business, lower the cost of storing and accessing the assets, and make it easier to generate revenue from the assets. If your media company is looking for a way to manage old tapes and undigitized videos, consider migrating the assets to S3.
The solution goes beyond extracting and storing metadata. An effective strategy includes creating a GUI or integrating it with existing asset management solutions to extract more meaningful data for editors to search from.
2nd Watch can provide consulting services to assist with these technical considerations and help accelerate the migration of media company assets to AWS. Contact us today to learn how we can support your media migration process!
Data sharing has become more complex, both in its application and our relationship to it. There is a tension between the need for personalization and the need for privacy. Businesses must share data to be effective and ultimately provide tailored customer experiences. However, legislation and practices regarding data privacy have tightened, and data sharing is tougher and fraught with greater compliance constraints than ever before. The challenge for enterprises is reconciling the increased demand for data with increased data protection.
The modern world runs on data. Companies share data to facilitate their daily operations. Data distribution occurs between business departments and external third parties. Even something as innocuous as exchanging Microsoft Excel and Google Sheets spreadsheets is data sharing!
Data collaboration is entrenched in our business processes. Therefore, rather than avoiding it, we must find the tools and frameworks to support secure and privacy-compliant data sharing. So how do we govern the flow of sensitive information from our data platforms to other parties?
The answer: data clean rooms. Data clean rooms are the modern vehicle for various data sharing and data governance workflows. Across industries – including media and entertainment, advertising, insurance, private equity, and more – a data clean room can be the difference-maker in your data insights.
There is a classic thought experiment wherein two millionaires want to find out who is richer without actually sharing how much money they are individually worth. The data clean room solves this issue by allowing parties to ask approved questions, which require external data to answer, without actually sharing the sensitive information itself!
In other words, a data clean room is a framework that allows two parties to securely share and analyze data by granting both parties control over when, where, and how said data is used. The parties involved can pool together data in a secure environment that protects private details. With data clean rooms, brands can access crucial and much-needed information while maintaining compliance with data privacy policies.
Data clean rooms have been around for about five years with Google being the first company to launch a data clean room solution (Google Ads Data Hub) in 2017. The era of user privacy kicked off in 2018 when data protection and privacy became law, most notably with the General Data Protection Regulation (GDPR).
This was a huge shake-up for most brands. Businesses had to adapt their data collection and sharing models to operate within the scope of the new legislation and the walled gardens that became popular amongst all tech giants. With user privacy becoming a priority, data sharing has become stricter and more scrutinized, which makes marketing campaign measurements and optimizations in the customer journey more difficult than ever before.
Data clean rooms are crucial for brands navigating the era of consumer protection and privacy. Brands can still gain meaningful marketing insights and operate within data privacy laws in a data clean room.
Data clean rooms work because the parties involved have full control over their data. Each party agrees upon access, availability, and data usage, while a trusted data clean room offering oversees data governance. This yields the secure framework needed to ensure that one party cannot access the other’s data and upholds the foundational rule that individual, or user-level data cannot be shared between different parties without consent.
Personally, identifying information (PII) remains anonymized and is processed and stored in a way that is not exposed to any parties involved. Thus, data sharing within a data clean room complies with privacy policies, such as GDPR and California Consumer Privacy Act (CCPA).
How does a data clean room work?
Let’s take a deeper dive into the functionality of a data clean room. Four components are involved with a data clean room:
#1 – Data ingestion
Data is funneled into the data clean room. This can be first-party data (generated from websites, applications, CRMs, etc.) or second-party data from collaborating parties (such as ad networks, partners, publishers, etc.)
#2 – Connection and enrichment
The ingested data sets are matched at the user level. Tools like third-party data enrichment complement the data sets.
#3 – Analytics
The data is analyzed to determine if there are intersections/overlaps, measurement/attribution, and propensity scoring. Data will only be shared where the data points intersect between the two parties.
#4 – Application
Once the data has finished its data clean room journey, each party will have aggregated data outputs. It creates the necessary business insights to accomplish crucial tasks such as optimizing the customer experience, performing reach and frequency measurements, building effective cross-platform journeys, and conducting deep marketing campaign analyses.
What are the benefits of a data clean room?
Data clean rooms can benefit businesses in any industry, including media, retail, and advertising. In summary, data clean rooms are beneficial for the following reasons:
You can enrich your partner’s data set.
With data clean rooms, you can collaborate with your partners to produce and consume data regarding overlapping customers. You can pool common customer data with your partners, find the intersection between your business and your partners, and share the data upstream without sharing sensitive information with competitors. An example would be sharing demand and sales information with an advertising partner for better-targeted marketing campaigns.
You can create governance within your enterprise.
Data clean rooms provide the framework to achieve the elusive “single source of truth.” You can create a golden record encompassing all the data in every system of records within your organization. This includes sensitive PII such as social security numbers, passport numbers, financial account numbers, transactional data, etc.
You can remain policy compliant.
In a data clean room environment, you can monitor where the data lives, who has access to it, and how it is used with a data clean room. Think of it as an automated middleman that validates requests for data. This allows you to share data and remain compliant with all the important acronyms: GDPR, HIPPA, CCPA, FCRA, ECPA, etc.
But you have to do it right…
With every data security and analytics initiative, there is a set of risks if the implementation is not done correctly. A truly “clean” data clean room will allow you to unlock data for your users while remaining privacy compliant. You can maintain role-based access, tokenized columns, and row-level security – which typically lock down particular data objects – and share these sensitive data sets quickly and in a governed way. Data clean rooms satisfy the need for efficient access and the need for the data producer to limit the consumer to relevant information for their use case.
Of course, there are consequences if your data clean room is actually “dirty.” Your data must be federated, and you need clarity on how your data is stored. The consequences are messy if your room is dirty. You risk:
Loss of customer trust
Fines from government agencies
Inadvertently oversharing proprietary information
Locking out valuable data requests due to a lack of process
Despite the potential risks of utilizing a data clean room, it is the most promising solution to the challenges of data-sharing in a privacy-compliant way.
To get the most out of your data, your business needs to create secure processes to share data and decentralize your analytics. This means pooling together common data with your partners and distributing the work to create value for all parties involved.
However, you must govern your data. It is imperative to treat your data like an asset, especially in the era of user privacy and data protection. With data clean rooms, you can reconcile the need for data collaboration with the need for data ownership and privacy.
2nd Watch can be your data clean room guide, helping you to establish a data mesh that enables sharing and analyzing distributed pools of data, all while maintaining centralized governance. Schedule time to get started with a data clean room.