Head of Infrastructure @ I run Pinterest's infrastructure engineering team. The team builds and owns Pinterest's core backend infrastructure including storage systems, caching, service framework and core business logic. We are also responsible for the scalability and long term direction of Pinterest's overall software architecture and building backend services that enable product teams to move fast and
Head of Infrastructure @ I run Pinterest's infrastructure engineering team. The team builds and owns Pinterest's core backend infrastructure including storage systems, caching, service framework and core business logic. We are also responsible for the scalability and long term direction of Pinterest's overall software architecture and building backend services that enable product teams to move fast and ship awesome features.
Here is a glimpse into some of the cool work we do: https://www.pinterest.com/omrvp/pinterest-infrastructure/ From April 2013 to Present (2 years 9 months) Senior Staff Software Engineer, Data Services @ Was Tech Lead for the Data Services team, which owns and operates Twitter's most critical storage systems, including the user store, tweet store, social graph store and timeline store.
During my time on the team, we oversaw enormous growth in each of these stores, not only in terms of data size, but also request throughput. Our main focus was on improving the reliability, efficiency and operability of these systems, and our efforts contributed to significantly higher availability for Twitter overall. Aside from this, we also embarked on designing and implementing a new distributed storage architecture for these services to meet Twitter's long term needs of scale, high performance, flexibility and operational ease.
My role was to be the technical point of contact for the team, serve as operational owner, drive technical direction, review code and designs and track progress of projects, while also continuing to write code when possible :) As a senior engineer in the company, I also participated in cross-company technical initiatives like the Twitter Architecture Group, helped shepherd projects through the design review process and vet designs for projects across Twitter Engineering. From September 2011 to April 2013 (1 year 8 months) Staff Software Engineer, Search @ Was tech lead and main contributor for SpiderDuck, a fast realtime URL fetcher service used to retrieve the content of all URLs shared in tweets within seconds after posting. The service was been very successful and powered major Twitter initiatives like #Discover, Twitter Cards and Universal Search. I authored a Twitter Eng blog post describing the project: http://engineering.twitter.com/2011/11/spiderduck-twitters-real-time-url.html.
I also contributed towards the design and implementation of Search Blender, a workflow framework and aggregator service and Search Facets, a project to surface media results in Twitter Search. I have also been an early adopter and minor contributor to Finagle, Twitter's RPC framework, as well as other Twitter open source projects like Twitter Commons and Util.
Links to blog posts describing some of the above projects:
Search Blender: http://engineering.twitter.com/2011/04/twitter-search-is-now-3x-faster_1656.html
Search Facets: http://engineering.twitter.com/2011/05/engineering-behind-twitters-new-search.html
Finagle: http://engineering.twitter.com/2011/08/finagle-protocol-agnostic-rpc-system.html From November 2010 to August 2011 (10 months) Senior Software Engineer, Search Infrastructure @ Senior engineer on Google's crawler team.
Designed and implemented a crawl sub-system to schedule DNS lookups at a large scale. This helped get regular DNS data for crawl bucketing, reduced latency of the crawl and significantly reduced burstiness of external nameserver traffic.
Designed and implemented analysis pipelines to detect and handle crawl pathologies like wildcard DNS and large scale parked domains. Built an automated analysis of the crawl’s URL discovery to learn path patterns that are useful or useless to Google web search, so as to adjust crawl priorities.
Made changes to the crawl system to be able to run Google’s mobile crawls within the main crawl system, thus freeing up 3 engineers from having to maintain a separate mobile crawl. Designed and implemented crawl scheduling changes to support the new incremental indexing system called Caffeine (http://googleblog.blogspot.com/2010/06/our-new-search-index-caffeine.html). This contribution was recognized with a Google Operating Committee (OC) award in June 2010. From March 2007 to October 2010 (3 years 8 months) Software Design Engineer II, Bing @ Engineer on the Bing search backend team.
Was the lead developer for the Search Macros feature and had end to end responsibility for it, with a focus on the backend store and protocols. Designed and implemented support in the search backend to collect, index, and rank non-web content. Also helped design a large scale distributed database used to store web documents in the search indexing system. From November 2005 to February 2007 (1 year 4 months) Software Design Engineer, Visual Studio @ Engineer on the Visual Studio / .NET Framework team.
Owned and developed a number of Visual Studio infrastructure components like code generation and parsing, designer hosting, resource management and localization support. Designed and implemented the settings storage model and client configuration API in .NET Framework 2.0. Was active in the Microsoft developer community through technical blogging, participation in dev labs and regular posting on forums. In particular, my blog on MSDN (http://blogs.msdn.com/b/rprabhu/) at one point ranked in the top 20 out of ~2000 MSDN blogs in terms of page views. I also appeared in an MSDN Channel 9 video (http://channel9.msdn.com/Blogs/TheChannel9Team/Raghavendra-Prabhu-Briefly-Inside-the-Windows-Forms-Designer). From July 2002 to October 2005 (3 years 4 months)
Master of Science (M.S.), Computer Science @ University of Illinois at Urbana-Champaign From 2001 to 2002 Raghavendra Prabhu is skilled in: Computer Science, Large Scale Systems, MapReduce, Scalability, Distributed Systems, Algorithms, Software Engineering, Big Data, Multithreading, Information Retrieval, Linux
Looking for a different
Get an email address for anyone on LinkedIn with the ContactOut Chrome extension