Shanmuga Priya's Email Addresses & Phone Numbers

📖 Summary

Hadoop Developer @ Nike • Installed and configured Hadoop MapReduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and processing.• Importing and exporting data into HDFS and Hive using Sqoop• Experienced in defining job flows• Experienced in managing and reviewing Hadoop log files• Experienced in running Hadoop streaming jobs to process terabytes of xml format data.• Load and transform large sets of structured, semi structured and unstructured data• Responsible to manage data coming from different sources• Supported Map Reduce Programs those are running on the cluster• Cluster coordination services through Zoo Keeper.• Involved in loading data from UNIX file system to HDFS.• Installed and configured Hive and also written Hive UDFs.• Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map way. Portland, ORLead Hadoop Developer @ Staples International, Inc Developed MapReduce programs to parse the raw data, populate staging tables and store the refined data in partitioned tables in the EDW. Created Hive queries that helped market analysts spot emerging trends by comparing fresh data with EDW reference tables and historical metrics. Enabled speedy reviews and first mover advantages by using Oozie to automate data loading into the Hadoop Distributed File System and PIG to pre-process the data. Provided design recommendations and thought leadership to sponsors/stakeholders that improved review processes and resolved technical problems. Managed and reviewed Hadoop log files. Tested raw data and executed performance scripts. Shared responsibility for administration of Hadoop, Hive and Pig. Dedham, MassachusettsHadoop Developer @ Boston Scientific Installed and configured MapReduce, HIVE and the HDFS; implemented CDH3 Hadoop cluster on CentOS. Assisted with performance tuning and monitoring. Created HBase tables to load large sets of structured, semi-structured and unstructured data coming from UNIX, NoSQL and a variety of portfolios. Supported code/design analysis, strategy development and project planning. Created reports for the BI team using Sqoop to export data into HDFS and Hive. Developed multiple MapReduce jobs in Java for data cleaning and preprocessing. Assisted with data capacity planning and node forecasting. Collaborated with the infrastructure, network, database, application and BI teams to ensure data quality and availability. Administrator for Pig, Hive and Hbase installing updates, patches and upgrades. From May 2010 to April 2013 (3 years) Boston, MassachusettsHadoop Developer @ Tata Consultancy Services IFP (Integrated Fraud Platform) is the Fraud applications containing the Fraud related data across all the states. This application is a small overall footprint, a mainframe based legacy ETL.The Hadoop conversion project is to offload the whole Mainframe ETL process to Hadoop. Roles and Responsibilities .Analyze and understanding the requirement given by downstream users .Provide cost and time estimates for development effort on Hadoop .Prepare the High Level and Low level Design documents depicting the prototype design and architecture .Prepare the Technical specification document to capture the technical requirements .Prepare the test plan and test scripts document Build code -Developed automated scripts for all jobs Starting from pulling the data from Mainframes to Loading to Mid-Range Systems From June 2007 to April 2010 (2 years 11 months) Greater Boston AreaJAVA Developer @ Syntel Led the migration of monthly statements from UNIX platform to MVC Web-based Windows application using Java, JSP, Struts technology. Prepared use cases, designed and developed object models and class diagrams. Developed SQL statements to improve back-end communications. Incorporated custom logging mechanism for tracing errors, resolving all issues and bugs before deploying the application in the WebSphere Server. Received praise from users, shareholders and analysts for developing a highly interactive and intuitive UI using JSP, AJAX, JSF and JQuery techniques. From May 2005 to May 2007 (2 years 1 month) Hyderabad