.advertise@offshoreoiljobs.co.uk

.www.offshoreoiljobs.co.uk

Category: Construction Engineering

API First Transformation at Etsy – Human aspects & developer adoption

This is the third post in a series of three about Etsy’s API, the abstract interface to our logic and data.In the last posts we covered how we built a new API framework, and we clearly identified the gains in terms of performance and shared abstraction layer between languages and devices. But how did we make an entire engineering organization switch to the new framework? How did we achieve the cultural transformation to API first? How do we avoid this…

Building a Better Mobile Crash Analytics Platform

‘Crashcan’ (think trashcan, but for crashes) is Etsy’s internal application for mobile crash analytics. We use an external partner to collect and store crash and exception data from our mobile apps, which we then ingest via their API. Crashcan is a single-page web app that refines and better exposes the crash data we receive from our external partner. Crashcan gives us extra analysis of our crashes on top of what our partner offers. We can make less cautious assumptions about…

How NPR Transcribes and Fact-Checks the Debates, Live – Features

For the presidential debate season, NPR is providing live transcripts of the debate with embedded fact checks and annotations throughout each debate night. Coordinating the workflow between live transcriptions, live fact-checking, and a live-updating page inside of our CMS was no small undertaking, resulting in what may have been our team’s most complicated technical architecture yet. I’m here to tell you all about it! Team Structure and Workflow On the Visuals Team, this project has combined our talents in a way we…

Open Sourcing a Deep Learning Solution for…

By Jay Mahadeokar and Gerry Pesavento Automatically identifying that an image is not suitable/safe for work (NSFW), including offensive and adult images, is an important problem which researchers have been trying to tackle for decades. Since images and user-generated content dominate the Internet today, filtering NSFW images becomes an essential component of Web and mobile applications. With the evolution of computer vision, improved training data, and deep learning algorithms, computers are now able to automatically classify NSFW image content with…

Personalized Group Recommendations on Flickr

There are two primary paradigms for the discovery of digital content. First is the search paradigm, in which the user is actively looking for specific content using search terms and filters (e.g., Google web search, Flickr image search, Yelp restaurant search, etc.). Second is a passive approach, in which the user browses content presented to them (e.g., NYTimes news, Flickr Explore, and Twitter trending topics). Personalization benefits both approaches by providing relevant content that is tailored to users’ tastes (e.g.,…

Omid’s First Step in the Apache Community

By Francisco Perez-Sorrosal, Ohad Shacham, Kostas Tsioutsiouliklis, and Edward Bortnikov We are proud to announce that Omid (“Hope” in Persian), Yahoo’s transaction manager for HBase [1][2], has been accepted as an Apache Incubator project. Yahoo has been a long-time contributor to the Apache community in the Hadoop ecosystem, including HBase, YARN, Storm, and Pig. Our acceptance as an Apache Incubator project is another step forward following the success of ZooKeeper [3] and BookKeeper [4], which were born at Yahoo and…

CI Automation at Zenefits – Zenefits Engineering

At Zenefits, it’s extremely important for us to uphold a high bar for code quality. Bugs and errors are costly – faulty decisions made by the application directly impact people’s lives, such as their healthcare or payroll. To maintain that high bar, merges into the master branch must meet strict quality criteria. Initially, engineers assumed this responsibility, and controlled the merges themselves. This allowed code to move pretty quickly through the pipeline. However, as the scale of the engineering organization…

Combining Druid and DataSketches for Real-time,…

By Himanshu Gupta Millions of users around the world interact with Yahoo through their web browsers and mobile devices, generating billions of events every day (e.g. clicking on ads, clicking on various pages of interest, and logging in). As Yahoo’s data grows larger and more complex, we are investing in new ways to better manage and make sense of it. Behavioral analytics is one important branch of analytics in which we are making significant advancements, and is helping us accomplish…

Duplo CI/CD Extensions For Microservices – Zenefits Engineering

In an earlier post, we described how Zenefits uses Duplo as a deployment engine and PaaS for hosting microservices. In this blog post we present the CI/CD challenges that arose and how Duplo’s Katkit component was used to address them.Since the adoption of micro-services, we have a few hundred docker containers linked to several AWS services, deployed and managed in a self-service way by application teams with almost zero administrative overhead. An important missing piece was an automated CI/CD platform…

Communicating with Non-Engineers – Lyft Engineering

Communicating with Non-Engineers As a Release Manager, I see many of the conversations that happen between engineering and other departments. I can relate to both sides. When I first joined Lyft, I thought that request and response were verbs you used when you had written the word “said” too many times. Coming from a non-CS background, I‘ve experienced how intimidating it can be to be working with a developer and comprehending only every fifth word they are saying. Since becoming…