Data Processing using AWS Glue

Founded in 2008, Legends is a premium experiences company with six divisions operating worldwide - Global Planning, Global Sales, Hospitality, Global Partnerships, Global Merchandise, and Global Technology Solutions - offering clients and partners a 360-degree service solution platform to elevate their brand and execute their vision.

    About the Customer

    Founded in 2008, Legends is a premium experiences company with six divisions operating worldwide - Global Planning, Global Sales, Hospitality, Global Partnerships, Global Merchandise, and Global Technology Solutions - offering clients and partners a 360-degree service solution platform to elevate their brand and execute their vision. Currently, Legends works with marquee clients across business verticals including professional sports; collegiate; attractions; entertainment; and conventions and leisure. We are the industry leaders in designing, planning and realizing exceptional experiences in sports and entertainment.

    Challenge

    Tech Holding is contracted with Legends to build an end-to-end hospitality platform that allows multiple clients (NBA, NFL, USGA) to list their inventory and create hospitality packages around it to sell at a higher price. This allows the client to package their tickets with Hotel, Travel, Dining, and add-on packages to create a hospitality package.

    Legends faced the challenge of managing and processing data from multiple sources, including Google Analytics, Salesforce and Salesforce Marketing Cloud. The data, arriving in both real-time and batch modes, needed to be processed efficiently and stored in a structured format for downstream analytics and reporting. The client required a scalable, automated ETL solution to consolidate data from these various sources and prepare it for use in business intelligence dashboards. Additionally, they needed a solution to handle large data volumes without compromising performance

    Why AWS

    AWS was selected due to its scalable infrastructure and a suite of fully managed services. With Amazon S3 for storage, AWS Glue for ETL, and Amazon Redshift for data warehousing, the client could seamlessly integrate data from multiple sources while leveraging AWS's reliability and cost-efficiency. AWS also provided native support for real-time data ingestion through AWS Kinesis and the ability to trigger data processing via AWS Lambda and ECS tasks.

    Why the Customer Chose the Partner

    Legends has selected Tech Holding because of our comprehensive experience in architecting and building cloud applications and services and our in-depth knowledge of creating large scale online applications. Tech Holding has a deep knowledge of integrating multiple endpoints with third party services via API, data ingestion and proven ability to architect and implement data pipelines and data warehouse at scale.

    Solution

    Tech Holding implemented a comprehensive data pipeline using AWS Glue to handle the ETL process for scheduled jobs. The solution leveraged AWS Lambda to periodically ingest data from Google Analytics and Salesforce Marketing Cloud into Amazon S3, which was then processed by AWS Glue. The key components included:

    • Amazon S3 as the central storage for all raw data.
    • Scheduled AWS Lambda jobs for ingesting data from Google Analytics and SFMC.
    • AWS Glue for transforming the ingested data and loading it into Amazon Redshift.
    • Amazon Redshift as the final destination for structured data used in dashboards and reporting.

    Results

    The solution automated the Legend’s ETL process, significantly reducing the need for manual data handling. AWS Glue effectively processed scheduled data from Google Analytics and SFMC, ensuring timely and accurate transformations. The client was able to maintain up-to-date insights and reporting through their BI dashboards.

    Metrics and Impact:

    80% reduction in manual data management, achieved by automating both scheduled and real-time ETL processes.

    50% improvement in data processing speed, leading to faster and more frequent report generation.

    Enhanced scalability, allowing the client to handle growing data volumes across multiple sources.

    Increased data accuracy and consistency, improving decision-making based on real-time and batch data.

    Accolades:

    The client praised the partner for delivering a robust, scalable solution that met their data processing needs. The implementation was completed on time, with the solution exceeding performance expectations, helping the client streamline their data workflows.

    About the Partner

    Tech Holding is founded around the premise of helping organizations achieve superior technological journeys using modern technology by providing AWS cloud-native services. We help organizations of varying sizes, from early-stage startups to large Fortune 50 companies, through their cloud journey. Our deep technology expertise in cloud transformation, mobile technology, and building scalable platforms is unparalleled. With our team of experienced Solution Architects, Product specialists, and Engineers, we can help you achieve new heights.

    APN Programs:

    AWS Partner - Advanced Level - Consulting Partner

    Amazon RDS Delivery Partner

    AWS Lambda Delivery Partner

    Amazon Open Search Delivery Partner

    Amazon API Gateway Delivery Partner

    Amazon ECS Delivery Partner

    Amazon Redshift Delivery Partner

    Amazon Cloudfront Delivery Partner

    AWS Solution Provider Partner

    Our Partners

    By using this site, you agree to thePrivacy Policy.