Randall Hauch (@rhauch) profile picture

Open source software developer, @Debezium founder, @ApacheKafka contributor, mentor for FIRST Robotics Competition Team @FRC4931, recovering rocket scientist

St. Louis
Joined August 2008
Photo by Randall Hauch (@rhauch)Photo by Randall Hauch (@rhauch)Photo by Randall Hauch (@rhauch)Photo by Randall Hauch (@rhauch)Photo by Randall Hauch (@rhauch)Photo by Randall Hauch (@rhauch)Photo by Randall Hauch (@rhauch)Photo by Randall Hauch (@rhauch)Photo by Randall Hauch (@rhauch)Photo by Randall Hauch (@rhauch)
Blogged: Kafka Connect Deep Dive – Converters and Serialization Explained <-- This is a proper written-from-experience post, covering some of the really common errors and misunderstandings I see people having with Kafka Connect confluent.io/blog/kafka-conn…
6
12
ZOMG, the latest @thoughtworks Tech Radar puts #Debezium on "assess" level! 🎉 "Debezium is an excellent choice [for] Change Data Capture and streaming data updates ... We’re using it in a few projects and it has worked very well for us."
3
31
2
60
Randall Hauch retweeted
Something that’s been on my mind lately is the fact that streaming database changes turns your data model into an API. Requires some consideration when doing DB schema migrations. riccomini.name/kafka-change-…
2
3
1
11
The #KafkaSummit SF 2018 recordings and slides are available NOW! Enjoy! cnfl.io/kssf2018
1
63
6
122
Randall Hauch retweeted
🔥 Full house at @rhauch #KafkaConnect talk #KafkaSummit
2
3
Randall Hauch retweeted
Today's event driven systems are really a new category. One that blends events and stream processors together to make rich but specific datasets available in a self service manner. I see companies implement these with four key patterns: Event-driven-2.0 confluent.io/blog/event-driv…
I just published the slides of my talk "I need my data and a little bit of your data. - Integrating services with Apache Kafka" from @confluentinc Streaming Event Munich. #csemunich @apachekafka Thank you again to everyone for that awesome event! speakerdeck.com/rk3rn3r/i-ne…
1
21
4
58
Randall Hauch retweeted
There is this terrific presentation on Apache Kafka by @nehanarkhede, essentially contrasting ETLs and data/event hubs: youtube.com/watch?v=I32hmY4d…
Randall Hauch retweeted
Replicate MySQL database into PostgreSQL between cloud and on-prem? I wrote new article on my blog where I show working configuration with #AWS #RDS #MySQL which is replicated using #Debezium and #Kafka deployed in #EKS #Kubernetes into #PostgreSQL jakubbujny.com/2018/09/20/re…
1
10
21
A Japanese spacecraft is just hours away from a historic attempt to land two tiny, hopping robots on the big asteroid Ryugu, and you can see near real-time photos of the spaceflight action. This video is truly wonderful. space.com/41892-hayabusa2-as…
5
165
16
357
Turns out this was caused by an N + 1 SELECT issue (one query per entry in pg_type) within the PG driver version we're using. By using a custom query for obtaining type metadata, we were able to get that user's start-up time from 24 min down to 5 sec.
Wow, just received a perf issue report by a user of the #Debezium connector for #Postgres, who has close to 200K entries in their pg_type catalog. While we got some work to do there, it's definitely encouraging to see Debezium being used in environments like this.
4
5
Randall Hauch retweeted
One trick for remembering someone's name when you first meet them is to immediately repeat back the wrong name so they'll just get used to you not being a name remembering kind of person; just get that expectation off the table for both parties from the start.
15
44
5
296
.@confluentinc is hiring! That's not really new. It's new that we opened up couple of new grad front-end/back-end engineering positions and we are extending our internship program! Front: jobs.lever.co/confluent/e8e6… Back: jobs.lever.co/confluent/e825… Interns: jobs.lever.co/confluent/17c0…
15
13
In the criminal justice system, the people are represented by two separate yet equally important groups: the police, who shoot them in their homes; and the district attorneys, who release irrelevant search warrants after the fact. These are their bullshit stories.
DEVELOPING: Search warrant: Marijuana found in Botham Jean’s apartment after deadly shooting bit.ly/2D2fd0u
902
14,355
576
63,002
Randall Hauch retweeted
Thanks for the interest. It came down to scale. Fan out on Kinesis didn't work from a throughput as well as number of consumers perspective. It also has a 500 Max number of shares limit that led us to have one Kinesis cluster consume from another so we could have the scale.
6
10
Lol. The rabbit hole goes deep when querying streaming events. @gwenshap #StrataData @apachekafka
2
1
11
We just had one of the most amazing and wonderful meals in years @BastionKinsale. Super talented chef and superb service!
1
2
8
.@zzbennett nails it in her blog post as to why events—and thus streams—matter, even to folk who are used to doing batch-based analytics. Streaming is not about niche real-time use cases—streaming is about *events*, which is what all data is composed of. multithreaded.stitchfix.com/… – at Oslo, Norway
1
2
Confluent is 4 today! Thank you to our employees, customers, partners, users & everyone around the globe who has contributed to our momentum & success! To celebrate, for the next 4 days, get 40% off your #KafkaSummit SF registration with code Confluent4. cnfl.io/kafkasummitSF
6
4
13
Super excited to finally share our paper "Streams and Tables: Two Sides of the Same Coin"! Hope you like it :) #kafka #kafkaStreams #ksql