Nirmal Sharma's Email Addresses & Phone Numbers

Data Specialist at Netflix @ Netflix Worked in Data science and Engineering for messaging team.Here i was responsible for designing and delivering solutions for relevant emails, push and in-app notifications to drive growth and content discovery.We tackle interesting challenges around user behaviour, viewing history,recommendation models, personalization and identifying data-driven solutions.Technologies: Hive, Pig, Mapreduce, building UDF's, Teradata, Python,...

Data Specialist at Netflix @ Netflix Worked in Data science and Engineering for messaging team.Here i was responsible for designing and delivering solutions for relevant emails, push and in-app notifications to drive growth and content discovery.We tackle interesting challenges around user behaviour, viewing history,recommendation models, personalization and identifying data-driven solutions.Technologies: Hive, Pig, Mapreduce, building UDF's, Teradata, Python, Shell scripting. From August 2014 to May 2015 (10 months) San Francisco Bay AreaLead Data Engineer at Adchemy @ Adchemy (acquired by Walmart Labs) In Walmartlabs, i was working in a SEARCH team and optimizing/redesigning the relevance/signals framework to run on 30 million items instead of currently running on 4 million items.In Adchemy, i was working on addressing lots of interesting and challenging data problems for our consumer facing BI application.Working on design and implementation of unique customer facing BI reporting system for the Adchemy that updates and reports the data almost real time.Performance is the key here so building the nextgen In-house platform to report and process high volume of data near real time.Technologies: Hadoop, MapReduce, Big Data, Postgres/Postgres-XC, Unix, Java ( almost all open source technologies) From January 2014 to August 2014 (8 months) Foster City, CASr. BI Engineer (Analytics) @ Hotwire (Acquired by Expedia) Working with data architecture team to scale the existing Informatica/Exadata/Microstrategy environment to satisfy the growing needs of business for data. Also, working on setting up the full end to end BigData solution (Cloudera hadoop clusters ) for various teams to facilitate the business decisions by processing terabytes of unstructured data on daily basis.In Hotwire, I have also been working closely with Database marketing and hotel supply team to develop analytical models and provide end-to-end Internet marketing solution using customer behavior data in datawarehouse and large Internet search log files e.g. Supply Opportunity Dashboard in Microstrategy (Top opportunities based on current supply not meeting demand) and Trend reporting for each market etcTechnologies: NoSQL,Hadoop Mapreduce/Hive (BigData), Exadata, Informatica, Microstrategy, Python, Shell scripting etc. From January 2012 to January 2014 (2 years 1 month) San Francisco Bay AreaTechnical Architect (Analytics - Quantitative Risk Analysis ) @ Bank of America Worked in BOA as technical architect in their Qualitative Risk Analytics group to migrate their legacy Datawarehouse from Teradata/Inforamatica to Netezza/Telend, along with Spotfire as reporting tool. Also, set-up their first hadoop cloudera cluster and wrote several map reduce jobs to process terabytes of files produced from moody's monte-carlo simulation ( and customers data file (Loan, Mortgages, Hedges etc)) which were difficult to process by legacy C++ application.Technologies: Netezza, Informatica, Hadoop Mapreduce/Hive (BigData), Python, Shell scripting etc. From June 2011 to January 2012 (8 months) Charlotte, North Carolina AreaTech. manager and architect @ Headstrong Consulting (Acquired by Genpect) Worked full time for FINRA client where i was involved in core end to end data engineering ( peta bytes of data processing, grid computing for performance improvement, data pattern matching, lots of POC's, set up new highly scalable/performance infrastructure etc ). Please look at my detail work description that i mentioned below for FINRA.Technologies: NETEZZA Mustang/Twinfin, Greenplum, DataStage8.1 with IBM GRID, Cognos, Autosys, Oracle, C++, SQL, Shell Scripting, Linux, UNIX. From February 2008 to May 2011 (3 years 4 months) Rockville,MDConsultant @ Headstrong Consulting (Acquired by Genpect) From May 2006 to February 2008 (1 year 10 months) Consultant @ FINRA This is the first place where I started working on processing petabytes of data on daily basis. I started here as consultant and over the period of 5 years I was extensively involved in core data engineering and eventually would become technical manager.• Moved their legacy system which was written in C++/Oracle and used to take 24 hrs to process 5 billion records on daily basis to Netezza and Datastage to process the same data in just less than 2 hours.• To further support the data processing demand and increasing volume, we wrote many UDF's in C++ within Netezza to customize its performance as per the system needs. Also, my team was amongst the first one to implement the solution to run Datastage ETL on IBM grid which increased its performance by 20 times.• Involved in providing the full end to end ETL solution for the new application using DataStage7.x/8.1,Netezza,Oracle and various programming language like C++, shell scripting etc. Also, i was directly involved with business to work on their OATS( order audit trailing system) application and implemented various algorithms to find any irregularities in day to day financial equity trading.• Was responsible for handling the offshore team of 13 people.Technologies: NETEZZA Mustang/Twinfin, Greenplum, DataStage8.1 with IBM GRID, Cognos, Autosys, Oracle, C++, SQL, Shell Scripting, Linux, UNIX. From 2006 to 2011 (5 years) Software Engineer @ Geometric Software Solution Ltd Worked on Solidworks ( CAD software ) and was involved in enhancement of the existing CAD (SolidWorks) software by writing various wrapper Stages in C++, VC++, design patterns, Value Object and Singleton PatternTechnologies: C++/VC++ at WINDOW From May 2005 to May 2006 (1 year 1 month) Design Engineer @ Bharat Heavy Electrical Ltd, Corporate R&D Worked with the engineering team to develop applications to process data generated from various power plants and determine the residual life of mechanical components of a turbine.Technologies: C++/VC++ at WINDOW From August 2003 to May 2005 (1 year 10 months) Tech Adviser and investor @ Startups Sr. Director - Data Engineering | Analytics | Distributed systems | Data Science platform @ Medallia San Francisco Bay AreaSr. Manager - Data Engineering at WalmartLabs @ Walmart Labs - Managed the team of more than 10 people and also responsible for rebuilding Walmartlabs Search data and analytics architecture.- Built smooth streaming pipeline to update search indexes real time ( pipeline is capable of processing 5000 events per second ). This streaming pipeline uses Kafka and spark streaming for event processing and cassandra to maintain the state of a product ( lookup and statefulness) and elastic search for logging to track the event lifecycle.- Replaced ad hoc analyst-driven scratch tables with fact- dimensional model across the teams- Refactored data ingestion pipelines (MySQL, Cassandra, Elastic Search, Hive/Hadoop, Kafka) with the code that follows industry best practices.- Built 'WINGS' - A light weight big data job management framework ( working on open sourcing soon )- Optimized and streamlined all the ML pipelines to run reasonable fast on distributed systems from scratch- Built inhouse ML platform ( which runs on kubernetes ) which is capable of easily reusing algorithms in different products, scaling to run number of simultaneous custom experiments, and managing experiments with ease.- Build real time analytics from grounds up- Optimized costs and performance by architecting universal logging system with the whole team to debug and track the product life cycle From May 2015 to August 2017 (2 years 4 months) Sunnyvale