The 2017 @Scale Conference is coming up August 31 at the San Jose Convention Center. This year’s event will feature tech talks by representatives of leading companies building technology at scale. Adobe, Amazon, Facebook, Google, Microsoft, Netflix, NVIDIA, Okta, Qualcomm, Shopify, Unity, Vicarious, and others will share innovative and scalable approaches to data management, developer tools, site reliability, video, machine learning, and technology for emerging markets.
This year will feature keynotes from Jay Parikh, head of engineering and infrastructure at Facebook, and Luis Ceze, of the University of Washington and Microsoft Research. Ceze will discuss DNA data storage and how engineers can borrow elements of nature to build better computers.
Check out the @Scale website for the full agenda and don’t forget to register! If you need a registration code, send us a message through the @Scale community page with your name, company, and email. Check out some talks from this year’s agenda below as well as some moments from last year’s event.
Azure Data Lake Store
Raghu Ramakrishnan, CTO for Data, Microsoft
Azure Data Lake Store (ADLS) is a fully managed, elastic, scalable, and secure file system that supports semantics of the Hadoop distributed file system (HDFS) and the Microsoft Cosmos file system. It is specifically designed and optimized for a broad spectrum of big data analytics that depend on an extremely high degree of parallel reads and writes, as well as colocation of compute and data for high-bandwidth and low-latency access. It brings together key components and features of Cosmos — long used internally at Microsoft as the warehouse for data and analytics — and HDFS. It also is a unified file storage solution for analytics on Azure. Internal and external workloads run on this unified platform. Distinguishing aspects of ADLS include its support for multiple storage tiers, exabyte scale, and comprehensive security and data sharing. Raghu Ramakrishnan will cover ADLS architecture, design points, the Cosmos experience, and performance.
PerfEnforce: A dynamic scaling engine for analytics with performance guarantees
Magda Balazinska, Professor and Data Science Institute Director, University of Washington
Magda Balazinska talks about PerfEnforce, a system that enables performance-oriented service-level agreements (SLAs) for data analytics. Using a set of tenants and query-level performance SLAs, she addresses how to dynamically assign compute resources to queries from each tenant (query scheduling). She also discusses how to dynamically resize the multi-tenant service to minimize costs due to compute resources and SLA violation penalties (resource provisioning).
Dev Tools & Ops Track
Keeping 2 billion lines of code moving forward
Collin Winter, Software Engineer, Google
Google’s codebase includes over 2 billion lines of code, spanning thousands of projects. This talk looks at how Google keeps such a large codebase nimble and evolving despite its size and scale.
Rapid web release at massive scale
Chuck Rossi, Engineering Director, Release Engineering, Facebook
This updated talk will give the latest details on how Facebook’s Release Engineering team ships facebook.com multiple times per day.
Hot Topics Track
Building successful teams at scale
This panel features leaders who have spent decades building successful teams that tackle large-scale technical challenges. Come hear how they’ve worked across disciplines, across oceans, and across their companies to move technology forward — while solving for the inherent difficulties of scaling technical management and managing technical teams at scale. Even as technology plays a greater role in society, this panel will highlight how people remain at the center of the code, infrastructure, and products that reach billions of people.
- Julia Grace, Head of Infrastructure Engineering, Slack
- Julie Pearl, Senior Director of E-commerce and Security & Privacy, Google
- S. Soma Somasegar, Managing Director, Madrona Venture Group
- Sri Viswanath, CTO, Atlassian
Building Live With
Nick Ruff, Software Engineer, Facebook
Last year Facebook started rolling out the ability for public figures to go live with a guest. Now Live With is available for all profiles and Pages on iOS, letting you invite a friend into your live video so you can hang out together, or broadcast the conversation to an audience. To make this possible, Facebook’s engineers worked to bring real-time interactive communication to broadcast-quality streams. In this talk, Nick Ruff will discuss how they bridged the trade-offs between video streaming technologies to enable real-time multiparty broadcasting.
Machine Learning Track
When all the world’s data scientists are just not enough
Shubha Nabar, Senior Director of Data Science, Salesforce
What if you had to build more machine-learned models than there are data scientists in the world? Well, at enterprise companies serving hundreds of thousands of businesses, this is precisely the case. In this talk, Shubha Nabar will walk through the scale challenges of building AI in the enterprise. She also will describe the general-purpose machine learning platform at Salesforce that automatically builds personalized models optimized for every business and every use case.
Unlocking meaning across languages at scale
Nacip Fazil Ayan, Engineering Manager, Facebook
At Facebook, the mission is to give people the power to build community and bring the world closer together. In this talk, Nacip Fazil Ayan will present the most recent work on using deep learning for machine translation and language understanding to unlock meaning across languages to help that mission. He will talk about the challenges of doing machine translation and language understanding at large scale, and will discuss technologies and platforms that have been built to tackle these challenges.