Lunch and Learn Information
May 14th, 2024
11:30 am – 1:00 pm
In-Person and Virtual
* **Note: This event will be held in-person. There will also be a virtual option for those that can not make it in-person. Please choose your ticket accordingly when registering. The link to join virtually will be sent out closer to the event date.
Imagine building and deploying data pipelines in just an afternoon, complete with advanced monitoring, automatic retries, deduplication, and cost-effective performance. Sounds too good to be true? Join us at Smart Data’s May Lunch and Learn, where we’ll discuss a recent project that seeks to make this a reality.Traditional data pipeline construction involves a time-consuming setup of infrastructure, coding, and governance. Transitioning to serverless architectures promises agility but still often falls into a manual and labor-intensive process. Our session will explore an “complete solution as code” approach that simplifies the creation of robust, serverless data pipelines on AWS, equipped with essential features like scheduled or event driven processes, automatic retries, alerting, and more. We’ll also touch on how these solutions translate to Azure environments, offering versatility across cloud platforms.Attendees will gain insights into the innovative technologies and methodologies driving this transformation, learning how to apply them to streamline their data management processes. Whether you’re a data engineer looking to enhance efficiency or a business leader seeking agile data solutions, this session will equip you with the knowledge to revolutionize your data pipeline strategy.
