Podcast: Play in new window | Download
“The more you’re comfortable with this idea that everything is going to fail, the more you realize that it’s a natural process of distributed systems, and it helps you write and architect better code.”
Druid is a column-oriented distributed database that excels as a data warehousing solution for fast queries on large data sets.
Fangjin Yang is a core contributor to Druid, and is currently co-founder and CEO of Imply, which helps build interactive analytics powered by Druid.
Questions
Why is it helpful for developers to acknowledge up front that “everything is going to fail”?
How often does a single server fail in cloud and distributed environments?
Can you describe a simple failure scenario where replication allows for recovery?
How do you implement fast recovery?
What is a hedged request?
What are some other strategies for minimizing variability among nodes?
What are some macroscopic lessons you learned about distributed systems while you were building Druid?
Links
Presentation: Architecting Distributed Databases for Failure
Druid
Imply
Fangjin on Twitter
Sponsors
Wealthfront is the automated investment service that manages your investments online. Check out wealthfront.com/sedaily to get your first $15,000 managed for free, as a listener of Software Engineering Daily.
Codeship is a fast and secure hosted Continuous Delivery platform that scales with your needs. Visit codeship.com to get started today.
Other Posts
MongoDB with Bryan Reinero
Apache Kafka with Guozhang Wang
Apache ZooKeeper with Flavio Junqueira
Share this:Click to share on Twitter (Opens in new window)Click to share on Facebook (Opens in new window)Click to share on LinkedIn (Opens in new window)Click to email this to a friend (Opens in new window)Comments
http://softwareengineeringdaily.com/2016/01/07/druid-with-fangjin-yang/