Real-time, operational data lineage tracing that helps data engineers and data scientists find, fix, and prevent operational issues.
Joined January 2020
- Tweets157
- Following17
- Followers366
- Likes33
Datakin retweeted
The news of our acquisition of Datakin broke in #TechCrunch. Hours later, at @DataCouncilAI in Austin, @J_ (Julien Le Dem) announced it from the stage!
Watch the announcement during the talk on #DataLineage with
#Airflow using @OpenLineage.
youtube.com/watch?v=lqz12s06…
Datakin retweeted
2/2 To see @rossturk himself dive deeper into OpenLineage (the OSS tool for data lineage), along with Staff Software Engineer @PeladoCollado, join them on Tuesday at 2 PM (ET) for our next webinar.
hubs.ly/Q016N5Tq0
Datakin retweeted
1/2 To operate in today’s distributed #data ecosystems, you need a complete and up-to-date picture of your data. And you can’t have one without #DataLineage. Learn why it matters, expertly explained by @rossturk, our Senior Director of Community. #blog
hubs.ly/Q0177vcx0
Datakin retweeted
The 80th edition of @data_weekly featuring
📚 @astronomerio ready for its next mission after @DatakinHQ acquisition, $213M Series C
📚 @jonloyens How Should We Be Thinking about Data Lineage?
dataengineeringweekly.com/p/…
Datakin retweeted
🚨🔥 new @dbt_labs Analytics Engineering Podcast episode is LIVE! @jthandy and I sit down with @J_ from @DatakinHQ / @OpenLineage to talk about open source data standards, data lineage, and tool connectivity.
Give it a listen👇
open.spotify.com/episode/1Tj…
Datakin retweeted
I'll be chatting today at 1:50pm PT with Kevin Mellott from @NM_Financial about lineage and metadata. @MarquezProject @OpenLineage
- @AashViswanathan, Senior Data Scientist @Atlassian
- Julien Le Dem (@J_) CTO and Co-Founder @DatakinHQ
- @SriniKadamati, Senior Data Scientist @preset_data
- Rohit Choudhary (@rconline), Founder and CEO @acceldataio
And many more! Check here👇
dataagility.io/#speakers
Datakin retweeted
- @AashViswanathan, Senior Data Scientist @Atlassian
- Julien Le Dem (@J_) CTO and Co-Founder @DatakinHQ
- @SriniKadamati, Senior Data Scientist @preset_data
- Rohit Choudhary (@rconline), Founder and CEO @acceldataio
And many more! Check here👇
dataagility.io/#speakers
Datakin retweeted
Context is key when it comes to making data decision quickly and decisively. Kevin and Julien explore successes with @OpenLineage at Northwestern Mutual and what they've learned along the way. See their talk Oct 21st at dataagilityday.com @DatakinHQ
Datakin retweeted
Some extra benefits of tracking your @getdbt lineage with @OpenLineage :
- you can connect multiple dbt projects in the same lineage graph
- you track the evolution of how long it takes model by model over time.
- you can track changes in your data to changes in your project.
“Models in @getdbt can get pretty messy. But this time, we will be rewarded with a gorgeous @marquezproject lineage graph. We’ll be able to see how everything fits together” - using @OpenLineage to make sense of it all!
datak.in/2ZL70t5
Datakin retweeted
Nice practical example by @rossturk of tracking your @getdbt runs with @OpenLineage and @MarquezProject
openlineage.io/blog/dbt-with…
Datakin retweeted
Need your data to be delivered reliably and correctly? Ross from Datakin gives a quick explainer of how we can help. datakin.com/#video
Datakin retweeted
Data quality metadata + lineage metadata —> a confident pipeline
“If you already have the @marquezproject Airflow DAG running, there’s nothing to do! @expectgreatdata tasks are already being detected and the metrics and assertion statuses are already being reported to your configured instance of Marquez.”
datak.in/3ARGKKO
Datakin retweeted
I'm all for this sort of observability based lineage model for data pipelines where you explicitly emit lineage information as jobs run vs. inferring it post hoc: datakin.com/real-time-data-l… - love this @DatakinHQ and @OpenLineage
Datakin retweeted
It was fun presenting with @wslulciuc. Some hands on @ApacheAirflow DAG observability with @OpenLineage and @MarquezProject .
You might have many DAGs in Airflow but they're one graph you can navigate in Marquez.
airflowsummit.org/sessions/2…
Datakin retweeted
Welcome @sorelove to @DatakinHQ! Congrats on releasing to prod on your first week.
We now have a Seattle office! Caveat, it's in Mike's basement.
CC @PeladoCollado
Datakin retweeted
Thank you Sanjeev Mohan @SanjMo, Ryan Murray @RyMurr42 of @Dremio, Julien Le Dm @J_ of @DatakinHQ, Wes McKinney of @UrsaComputing @WesMckinn & Ryan Blue for an excellent Open Data Architecture panel yesterday. It was a great way to close out @SubsurfaceConf! #datalake #lakehouse
ALT The Open Data Architecture panel at @SubsurfaceConf
Datakin retweeted
awesome to see @OpenLineage grow as a project! Julien is super talented and has been pushing for a sane metadata collection API in the data space
This is official! @OpenLineage is part of the LF AI & Data Foundation. Driven by the community, for the community.
Datakin retweeted
There is critical need for reliable data operations and understanding how data is flowing through our systems. Watch @J_ from this year's #bbuzz to learn how to create Data pipelines that are auditable, reliable and run on time with OpenLineage. youtu.be/HEJFCQLwdtk
Datakin retweeted
We're excited to announce that the Marquez integrations for Airflow, Spark and DBT will be the official integrations for @OpenLineage! 🎉 To learn more about the high-level timeline of when the integration will be moved over, see: github.com/OpenLineage/OpenL…
