.advertise@offshoreoiljobs.co.uk

.www.offshoreoiljobs.co.uk

Category: Civil Engineering

Open Sourcing a Deep Learning Solution for…

By Jay Mahadeokar and Gerry Pesavento Automatically identifying that an image is not suitable/safe for work (NSFW), including offensive and adult images, is an important problem which researchers have been trying to tackle for decades. Since images and user-generated content dominate the Internet today, filtering NSFW images becomes an essential component of Web and mobile applications. With the evolution of computer vision, improved training data, and deep learning algorithms, computers are now able to automatically classify NSFW image content with…

Personalized Group Recommendations on Flickr

There are two primary paradigms for the discovery of digital content. First is the search paradigm, in which the user is actively looking for specific content using search terms and filters (e.g., Google web search, Flickr image search, Yelp restaurant search, etc.). Second is a passive approach, in which the user browses content presented to them (e.g., NYTimes news, Flickr Explore, and Twitter trending topics). Personalization benefits both approaches by providing relevant content that is tailored to users’ tastes (e.g.,…

Omid’s First Step in the Apache Community

By Francisco Perez-Sorrosal, Ohad Shacham, Kostas Tsioutsiouliklis, and Edward Bortnikov We are proud to announce that Omid (“Hope” in Persian), Yahoo’s transaction manager for HBase [1][2], has been accepted as an Apache Incubator project. Yahoo has been a long-time contributor to the Apache community in the Hadoop ecosystem, including HBase, YARN, Storm, and Pig. Our acceptance as an Apache Incubator project is another step forward following the success of ZooKeeper [3] and BookKeeper [4], which were born at Yahoo and…

CI Automation at Zenefits – Zenefits Engineering

At Zenefits, it’s extremely important for us to uphold a high bar for code quality. Bugs and errors are costly – faulty decisions made by the application directly impact people’s lives, such as their healthcare or payroll. To maintain that high bar, merges into the master branch must meet strict quality criteria. Initially, engineers assumed this responsibility, and controlled the merges themselves. This allowed code to move pretty quickly through the pipeline. However, as the scale of the engineering organization…

Combining Druid and DataSketches for Real-time,…

By Himanshu Gupta Millions of users around the world interact with Yahoo through their web browsers and mobile devices, generating billions of events every day (e.g. clicking on ads, clicking on various pages of interest, and logging in). As Yahoo’s data grows larger and more complex, we are investing in new ways to better manage and make sense of it. Behavioral analytics is one important branch of analytics in which we are making significant advancements, and is helping us accomplish…

Duplo CI/CD Extensions For Microservices – Zenefits Engineering

In an earlier post, we described how Zenefits uses Duplo as a deployment engine and PaaS for hosting microservices. In this blog post we present the CI/CD challenges that arose and how Duplo’s Katkit component was used to address them.Since the adoption of micro-services, we have a few hundred docker containers linked to several AWS services, deployed and managed in a self-service way by application teams with almost zero administrative overhead. An important missing piece was an automated CI/CD platform…

Communicating with Non-Engineers – Lyft Engineering

Communicating with Non-Engineers As a Release Manager, I see many of the conversations that happen between engineering and other departments. I can relate to both sides. When I first joined Lyft, I thought that request and response were verbs you used when you had written the word “said” too many times. Coming from a non-CS background, I‘ve experienced how intimidating it can be to be working with a developer and comprehending only every fifth word they are saying. Since becoming…

White Rock Fire Results in Boil Water – UrbanWorkbench

Fighting the flames had put such a demand on the small local #water system that the city’s reservoirs dropped to “dangerously low” levels, explained councillor David Chesney. “We haven’t drained our reservoirs, but they’ve gone down a tremendous amount in fighting this #fire,” “We’ve not had any indication that there is a major problem yet, but … we just want to err on the safe side that we don’t endanger anyone’s life,” Chesney said. via White Rock fire causes water problems…

Our Justified Layout Goes Open Source

We introduced the justified layout on Flickr.com late in 2011. Our community of photographers loved it for its ability to efficiently display many photos at their native aspect ratio with visually pleasing, consistent whitespace, so we quickly added it to the rest of the website. It’s been through many iterations and optimizations. From back when we were primarily on the PHP stack to our lovely new JavaScript based isomorphic stack. Last year Eric Socolofsky did a great job explaining how…

Configuration management for distributed systems (using GitHub and cfg4j)

Norbert Potocki, Software Engineer @ Yahoo Inc. Warm up: Why configuration management? When working with large-scale software systems, configuration management becomes crucial; supporting non-uniform environments gets greatly simplified if you decouple code from configuration. While building complex software/products such as Flickr, we had to come up with a simple, yet powerful, way to manage configuration. Popular approaches to solving this problem include using configuration files or having a dedicated configuration service. Our new solution combines the extremely popular GitHub and…