SESSION Details
Synapse Data Flows - Will Citizen ETL Replace the Data Engineer?
We're in the middle of a data lake boom, with companies investing huge amounts in new lake-based data platforms, and all of the engineering that comes with it. But what if you don't want to learn python? What if your data experts aren't even comfortable with SQL? How do we bring data transformation to the people who understand the business?
Synapse Data Flows is a low code drag and drop "citizen ETL" tool, but under the hood it uses the incredibly powerful Apache Spark clusters to interpret and execute your transformations. But how far can you take it? Is this the death of SQL and Python, or are Mapping Data Flows just intended for lightweight projects?
In this session we'll talk about what Mapping Data Flows can do, what it can't do and how far you can take them in building a data platform framework
Feedback link: https://sqlb.it/?7135
Starts: 10:50 12th Mar 2022
Ends: 11:10 12th Mar 2022
Q&As
Short Description
- In this session we'll talk about what Mapping Data Flows can do, what it can't do and how far you can take them in building a data platform framework.
Slidedeck Link
Zach Stagers - SQLBits 2022 - Synapse Data Flows.pdf
Speakers
Zach Stagers
Tags
AzureIntelligence and AnalyticsNoCode Data EngineerDevelopingSynapse AnalyticsBeginner
The SQL Bits Story
SQLBits was formed in 2007 by a group of volunteers who were passionate about the SQL Server product suite and wanted to provide much-needed community-driven education to the data community.
As one of the largest data platform conferences in the world, we offer more opportunities to a wider audience.
15 Years
We’ve grown and expanded a lot since 2007.
2500 Participants
SQLBits is the best place to meet fellow data professionals.
82 Countries
We welcome data professionals from all over the globe.
1140 recorded sessions
All the live sessions are recorded and offered for free, year round.
Experience the SQLBits Conference
Want to be part of the SQLBits community?
Attend the London conference in-person or virtually on
March 8-12, 2022 at ExCel London, UK.
