When you have to make it faster Marc Sugiyama Niko Tsikoudis Code BEAM America 21

This video was recorded at Code BEAM America 2021 - When you have to make it faster Marc Sugiyama Niko Tsikoudis - Experienced Erlang engineer Software Engineer at Datometry ABSTRACT Our product Hyper-Q enables modern cloud data warehouses to emulate Teradata aiding with the migration of on-premises solutions to the cloud. Hyper-Q translates existing applications queries in real-time to run natively in the cloud and converts data received from the cloud into the format needed by the application. We recently missed service level agreements with a customer because our product Hyper-Q added significant overhead to a data warehouse application. Through careful investigation using profilers continuous improvement and focused engineering considering Erlang characteristics we doubled our performance and improved system scalability. This talk describes the steps and techniques we used to understand where to focus our engineering efforts and beat our service level agreements. Timecodes 00:00 - 04:44 - Introduction to Datometry Hyper Q 04:45 - 06:05 - Customer Incident 06:06 - 08:25 - In House Reproduction 08:26 - 09:55 - Identifying Dominant Cost 09:56 - 15:22 - How do we make Data Conversion Faster? 15:23 - 17:21 - Optimization Example 17:22 - 17:52 - Result 17:53 - 19:30 - Profiling Takeaways 19:31 - 23:50 - Binary Optimizations 23:51 - 26:22 - Improvements 26:23 - 27:16 - Optimizations 27:17 - 28:06 - Next Steps 28:07 - 35:14 - QnA Follow us on social: Twitter: LinkedIn: Looking for a unique learning experience? Attend the next Code Sync conference near you! See whats coming up at: SUBSCRIBE TO OUR CHANNEL See whats coming up at: ,

#