Elena Samuylova and Emeli Dral are the co-founders of Evidently AI, where they build open source tools to analyze and monitor machine learning models. Elena was previously the head of the startup ecosystem at Yandex, director of business development at their data factory and chief product officer at Mechanica AI. Emeli was previously a data scientist at Yandex, chief data scientist at the data factory and Mechanica AI in addition to teaching machine learning both online and at multiple universities.Learn more about Elena, Emeli, and Evidently AI:https://evidentlyai.com/https://twitter.com/elenasamuylovahttps://twitter.com/EmeliDralEvery Thursday I send out the most useful things I’ve learned, curated specifically for the busy machine learning engineer. Sign up here: http://cyou.ai/newsletterFollow Charlie on Twitter: https://twitter.com/CharlieYouAISubscribe to ML Engineered: https://mlengineered.com/listenComments? Questions? Submit them here: http://bit.ly/mle-surveyTake the Giving What We Can Pledge: https://www.givingwhatwecan.org/Timestamps:02:15 How Emeli and Elena each got started in data science07:10 Applying machine learning across a wide variety of industries at the Yandex Data Factory14:55 Using ML for industrial process improvement23:35 Challenges encountered in industrial ML and technical solutions27:15 The huge opportunity for ML in manufacturing34:35 How to ensure safety when using models in physical systems37:40 Why they started working on tools for data and ML monitoring42:50 Different kinds of data drift and how to address them48:25 Common mistakes ML teams make in monitoring55:25 Features of Evidently AI's library57:35 Building open source software01:02:25 Technical roadmap for Evidently01:05:50 Monitoring complex data01:08:50 Business roadmap for Evidently01:11:35 Rapid fire questionsLinks:Evidently on GithubEvidently AI's BlogThinking Fast and SlowFlowDoing Good Better