
#DataFactory #AzureDataFactory Microsoft Azure Twitter Account for Azure Data Factory (ADF). Serverless Data Integration ETL in the Cloud. https://xitter.cf/t.co/PDWAfrdt0R
Redmond, WA
Joined August 2018
- Tweets2.2K
- Following113
- Followers8.1K
- Likes3.7K
Landing this month in #Microsoft #Fabric #DataFactory pipelines ... Edit your JSON code behind the canvas designer!
#MicrosoftCommunity asked and we listened! Thank you as always for the feedback.
Invoking data integration ETL pipelines when a file arrives or deletes is a common pattern when you cannot rely on a wall-clock scheduling mechanism.
Watch as Mark @KromerBigData walks through how to do this in #Microsoft #Fabric #DataFactory and more!
youtu.be/kLko6bWy9sw
Are you an experienced #Azure #DataFactory pipeline developer and want to hear 5 tips about transitioning from ADF to #Microsoft #Fabric #DataFactory!
Mark @kromerbigdata has you covered:
5 Tips for ADF pipeline developers moving to Fabric
youtube.com/watch?v=PF6A-fBH…
In this new #Microsoft #Fabric blog, @KromerBigData continues his blog post series on #DataFactory data pipelines in Fabric by demonstrating several different methods and good practices to automate and execute your Fabric DW queries and commands.
blog.fabric.microsoft.com/en…
In this new video, @KromerBigData shows you how to make a new Dataflow in #MicrosoftFabric #DataFactory that does exactly the same transformation job a #MappingDataFlow in #Azure #DataFactory.
youtu.be/4-1Tu2UoEns
🚨🚨
We've just updated the Flatten transformation so that you can now easily unroll multiple arrays from a single Flatten transformation step!
Now available in both #Azure #DataFactory and @Azure_Synapse data flows.
techcommunity.microsoft.com/…
Hey #Azure #DataFactory fans!
@KromerBigData demonstrates the latest enhancements we've made to CDC in ADF with micro-batch change data capture and schema drift ... all in dark mode!
youtu.be/OF6PeYMWqKg
We've just released the public preview of the pipeline return value feature!
Pipeline creators can now customize the output value of a pipeline and consume that value in the caller.
This makes the common child-parent pipeline pattern more more powerful!
techcommunity.microsoft.com/…
Replying to @KromerBigData
@KromerBigData demonstrates the latest Change Data Capture features in #Azure #DataFactory.
Build a CDC process in minutes without a pipeline, data flow, or trigger!
youtu.be/YTxANiAPAKs
Replying to @JohannesVink
You need to hover over the port until you see the finger pointer, then you can add more activities to that port.
Yes, you can do this in a data flow. In the Sink, set the sink type to an "inline" Cosmos DB dataset. On the sink settings tab, you can parameterize the name of your container to create on the fly. Lastly, be sure to select "Recreate container" as your Container Action.
Replying to @NowinskiK @KromerBigData
You may need to refetch the source definition by invalidating the data preview cache. Go to the source transformation and click Refresh > Refetch from sources
Replying to @KromerBigData
@KromerBigData walks through several good practices, tips, and tricks when debugging data flows in #Azure #DataFactory and @Azure_Synapse
Learn how to use & explore data samples for the best debugging experience & right-size the debug environment.
youtube.com/watch?v=pVvHskS1…
📢ICYMI: Built-in support for native SQL change data capture is available for #Azure #DataFactory & @Azure_Synapse!
Check out this demo by @KromerBigData to see it in action: youtu.be/Qu9u69pkC5o










