LinkedIn is working to train all of its engineers on the basics of implementing artificial intelligence as part of the company’s implementation of new technologies to make its professional social network smarter.
“The demand for AI across the company has increased enormously,” Deepak Agarwal, the head of artificial intelligence at LinkedIn, said during an onstage interview at VB Summit 2017 today. “Everyone wants to have AI as a component of their product.” So how do we scale the workforce is a big thing that keeps me up at night.”
The company has launched an AI academy for its engineers that is designed to give people a grounding in the basics of implementing artificial intelligence, so that it’s possible for them to deploy intelligent models in the company’s products.
LinkedIn has a great need for artificial intelligence, since the company’s business is built on the back of recommendations. For example, the professional social network will recommend potential connections, jobs, content, marketing opportunities and a wide variety of other interactions.
“AI is like oxygen at LinkedIn, it permeates every single member experience,” Agarwal said. “And just to give you an idea of the scale, we process more than 2PB of data both nearline and offline every single day.”
The academy isn’t designed to give engineers an academic grounding in machine learning as a discipline. It’s designed instead to prepare them for using AI in much the same way that they’d use a system like QuickSort, an algorithm for sorting data that’s fed into it. Users don’t have to understand how the underlying system works, they just need to know the right way to implement it.
That’s the goal for LinkedIn, Agarwal said. Thus far, six engineers have made it through the AI academy and are deploying machine learning models in production as a result of what they learned. The educational program still has a ways to go (Agarwal said he’d grade it about a “C+ at the moment) but it has the potential to drastically affect LinkedIn’s business.
Agarwal’s comments echo — to a degree — those made earlier in the day by Gil Arditi, the product lead for Lyft’s AI platform team. In Arditi’s view, one of the most pressing problems facing the ride hailing company is a dearth of qualified AI talent.
As it stands, creating a machine learning system still requires a number of skilled practitioners who can help wrangle the data and tweak the parameters needed to optimize the system. Those people are generally hard to come by and expensive to hire. Distributing AI knowledge across LinkedIn’s entire organization could help the company keep up with its demand for intelligent capabilities.
