.advertise@offshoreoiljobs.co.uk

.www.offshoreoiljobs.co.uk

Category: Civil Engineering

Then and Now: The Rethinking of Time Series Data at Wayfair

As Wayfair has grown and matured its software development and data center operations over the past decade, and particularly over the last five years, we have embraced the principle of providing maximum visibility into our processes and systems. The result is a very large logging and time series infrastructure built to receive a constant stream of application logs and metrics. Our logging infrastructure, built on the Elasticsearch stack, has benefited from continuous improvements from the Elastic company, as well as…

MU’s Engineers Without Borders continues efforts in Panama

A group of eight engineering students, two faculty members and two MU alums decided against traditional spring break trips in favor of a more charitable, alternative spring break venture. As part of Engineers Without Borders, the MU chapter traveled to Majé de Chimán, Panama, as part of their continued efforts to provide a reliable water distribution, filtration and storage system for the community there. Photos courtesy of Mizzou Engineers Without Borders. As part of Engineers Without Borders, the MU chapter…

Continuous Deployment with Spark Streaming (Part II) – Wealthfront Engineering Blog

In Part 1 of this series, we gave a brief look into the data platform at Wealthfront, focusing on how we minimize data processing downtime while redeploying our Spark Streaming jobs. In this final part of this series, we will describe how we coordinate the data in our serving layer and wrap the blog post up by showing how all the pieces fit together to make redeployments invisible to our customers. Coordinating the Serving Layer Our serving layer consists of…

Engineers propose coordinated control to assist drivers

Engineers have proposed a coordinated control architecture for motion management in advanced driver assistance systems (ADAS) to increase safety and comfort across all vehicles, regardless of ADAS specifics. They published their proposal in IEEE/CAA Journal of Automatica Sinica, a joint publication of the IEEE and the Chinese Association of Automation. “The modern automobile is a complex system of systems. How the functionalities of advanced driver assistance are implemented and coordinated across the systems of the vehicle is generally not…

Scaling for Growth: A Q&A with Uber’s VP of Core Infrastructure, Matthew Mengerink

As the Vice President of Engineering for Uber’s Core Infrastructure group, Matthew Mengerink faces a daunting task. He oversees 350 engineers across four teams tasked with not only maintaining the platform on which 3,500 microservices run, but also figuring out how to scale, improve, and modernize that infrastructure for Uber’s future. Joining Uber in September 2017, Matthew brings experience managing infrastructure at technology stalwarts such as eBay, PayPal, and, most recently, YouTube. He mixes this technical pedigree with a candid…

Sealed classes opened my mind

How we use Kotlin to tame state at Etsy Bubbly the Baby Seal by SmartappleCreations Etsy’s apps have a lot of state.  Listings, tags, attributes, materials, variations, production partners, shipping profiles, payment methods, conversations, messages, snippets, lions, tigers, and even stuffed bears.   All of these data points form a matrix of possibilities that we need to track.  If we get things wrong, then our buyers might fail to find a cat bed they wanted for Whiskers.  And that’s a…

Continuous Deployment with Spark Streaming (Part I) – Wealthfront Engineering Blog

Here at Wealthfront, our mission is to democratize access to sophisticated financial advice. One of the ways we accomplish that is by applying data processing technologies to financial services. In this two-part blog post we will describe how our near-real time data platform is built to support continuous deployment in order to allow us to ship new features quickly and safely. Part 1 of this series will give a high level overview of the data platform at Wealthfront and describe…

Continuous Deployment with Spark Streaming (Part I) – Engineering Blog

Here at Wealthfront, our mission is to democratize access to sophisticated financial advice. One of the ways we accomplish that is by applying data processing technologies to financial services. In this two-part blog post we will describe how our near-real time data platform is built to support continuous deployment in order to allow us to ship new features quickly and safely. Part 1 of this series will give a high level overview of the data platform at Wealthfront and describe…

Netflix FlameScope – Netflix TechBlog – Medium

We’re excited to release FlameScope: a new performance visualization tool for analyzing variance, perturbations, single-threaded execution, application startup, and other time-based issues. It has been created by the Netflix cloud performance engineering team and just released as open source, and we welcome help from others to develop the project further. (If it especially interests you, you might be interested in joining Netflix to work on it and other projects.) FlameScope combines a subsecond-offset heatmap for navigating a profile with flame…

Scaling Uber’s Hadoop Distributed File System for Growth

Three years ago, Uber Engineering adopted Hadoop as the storage (HDFS) and compute (YARN) infrastructure for our organization’s big data analysis. This analysis powers our services and enables the delivery of more seamless and reliable user experiences. We use Hadoop for both batch and streaming analytics across a wide range of use cases, such as fraud detection, machine learning, and ETA calculation. As Uber’s business grew over the last few years, our volume of data and the associated access loads…