Portfolio » Facebook Topic Data
At DataSift, we built the next generation, privacy-first analysis platform for Facebook Topic Data. Facebook Topic Data shows marketers what audiences are saying on Facebook about events, brands, subjects and activities, all in a way that keeps personal information private. Marketers use the information from topic data to make better decisions about how they market on Facebook and other channels, and build product roadmaps.
Our PYLON platform was chosen by Facebook to handle over 17 billion posts, comments and likes produced each day, at a rate of ~200,000 posts per second.
It's been the first (and only) external platform to be deployed within Facebook's data centres and to have access to all public and private posts and engagements, thanks to the strong security and privacy-focused properties of our platform.
I supervised the technical and security due diligence, the design and implementation of the platform, and its deployment, as well as the technical coordination with Facebook sponsors and engineers.
We developed a multi-tenant analytics layer to slice through billions of documents in a privacy-safe way. We implemented several patent-pending innovations in streaming and analytics platforms, and devised a strong yet simple to understand set of privacy policies that are GDPR compliant.
Introduction to our product: Video | Slides | PYLON use cases | Press Release | TechCrunch article