Hadoop Developer at Nike
Portland, Oregon
Nike
Hadoop Developer
Portland, OR
Staples International, Inc
Lead Hadoop Developer
Dedham, Massachusetts
Boston Scientific
Hadoop Developer
May 2010 to April 2013
Boston, Massachusetts
Tata Consultancy Services
Hadoop Developer
June 2007 to April 2010
Greater Boston Area
Syntel
JAVA Developer
May 2005 to May 2007
Hyderabad
• Installed and configured Hadoop MapReduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and processing.• Importing and exporting data into HDFS and Hive using Sqoop• Experienced in defining job flows• Experienced in managing and reviewing Hadoop log files• Experienced in running Hadoop streaming jobs to process terabytes of xml format data.• Load and transform... • Installed and configured Hadoop MapReduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and processing.• Importing and exporting data into HDFS and Hive using Sqoop• Experienced in defining job flows• Experienced in managing and reviewing Hadoop log files• Experienced in running Hadoop streaming jobs to process terabytes of xml format data.• Load and transform large sets of structured, semi structured and unstructured data• Responsible to manage data coming from different sources• Supported Map Reduce Programs those are running on the cluster• Cluster coordination services through Zoo Keeper.• Involved in loading data from UNIX file system to HDFS.• Installed and configured Hive and also written Hive UDFs.• Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map way.
What company does Shanmuga Priya work for?
Shanmuga Priya works for Nike
What is Shanmuga Priya's role at Nike?
Shanmuga Priya is Hadoop Developer
What industry does Shanmuga Priya work in?
Shanmuga Priya works in the Information Technology and Services industry.
Who are Shanmuga Priya's colleagues?
Shanmuga Priya's colleagues are Bahaddin Acar, Kalle Edberg, Daniel Tuttle, Andy Woodfine, Alexander Bradley, Mitch V., Helen Huang, Tiffany wu, Winny Chen, and Hengky Gozal
📖 Summary
Hadoop Developer @ Nike • Installed and configured Hadoop MapReduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and processing.• Importing and exporting data into HDFS and Hive using Sqoop• Experienced in defining job flows• Experienced in managing and reviewing Hadoop log files• Experienced in running Hadoop streaming jobs to process terabytes of xml format data.• Load and transform large sets of structured, semi structured and unstructured data• Responsible to manage data coming from different sources• Supported Map Reduce Programs those are running on the cluster• Cluster coordination services through Zoo Keeper.• Involved in loading data from UNIX file system to HDFS.• Installed and configured Hive and also written Hive UDFs.• Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map way. Portland, ORLead Hadoop Developer @ Staples International, Inc Developed MapReduce programs to parse the raw data, populate staging tables and store the refined data in partitioned tables in the EDW. Created Hive queries that helped market analysts spot emerging trends by comparing fresh data with EDW reference tables and historical metrics. Enabled speedy reviews and first mover advantages by using Oozie to automate data loading into the Hadoop Distributed File System and PIG to pre-process the data. Provided design recommendations and thought leadership to sponsors/stakeholders that improved review processes and resolved technical problems. Managed and reviewed Hadoop log files. Tested raw data and executed performance scripts. Shared responsibility for administration of Hadoop, Hive and Pig. Dedham, MassachusettsHadoop Developer @ Boston Scientific Installed and configured MapReduce, HIVE and the HDFS; implemented CDH3 Hadoop cluster on CentOS. Assisted with performance tuning and monitoring. Created HBase tables to load large sets of structured, semi-structured and unstructured data coming from UNIX, NoSQL and a variety of portfolios. Supported code/design analysis, strategy development and project planning. Created reports for the BI team using Sqoop to export data into HDFS and Hive. Developed multiple MapReduce jobs in Java for data cleaning and preprocessing. Assisted with data capacity planning and node forecasting. Collaborated with the infrastructure, network, database, application and BI teams to ensure data quality and availability. Administrator for Pig, Hive and Hbase installing updates, patches and upgrades. From May 2010 to April 2013 (3 years) Boston, MassachusettsHadoop Developer @ Tata Consultancy Services IFP (Integrated Fraud Platform) is the Fraud applications containing the Fraud related data across all the states. This application is a small overall footprint, a mainframe based legacy ETL.The Hadoop conversion project is to offload the whole Mainframe ETL process to Hadoop. Roles and Responsibilities .Analyze and understanding the requirement given by downstream users .Provide cost and time estimates for development effort on Hadoop .Prepare the High Level and Low level Design documents depicting the prototype design and architecture .Prepare the Technical specification document to capture the technical requirements .Prepare the test plan and test scripts document Build code -Developed automated scripts for all jobs Starting from pulling the data from Mainframes to Loading to Mid-Range Systems From June 2007 to April 2010 (2 years 11 months) Greater Boston AreaJAVA Developer @ Syntel Led the migration of monthly statements from UNIX platform to MVC Web-based Windows application using Java, JSP, Struts technology. Prepared use cases, designed and developed object models and class diagrams. Developed SQL statements to improve back-end communications. Incorporated custom logging mechanism for tracing errors, resolving all issues and bugs before deploying the application in the WebSphere Server. Received praise from users, shareholders and analysts for developing a highly interactive and intuitive UI using JSP, AJAX, JSF and JQuery techniques. From May 2005 to May 2007 (2 years 1 month) Hyderabad
Extraversion (E), Sensing (S), Thinking (T), Perceiving (P)
2 year(s), 8 month(s)
Unlikely
Likely
There's 100% chance that Shanmuga Priya is seeking for new opportunities
Enjoy unlimited access and discover candidates outside of LinkedIn
Trusted by 400K users from
76% of Fortune 500 companies
The most accurate data ever
Hire Anyone, Anywhere
with ContactOut today
Making remote or global hires? We can help.
No credit card required
Shanmuga Priya's Social Media Links
/company/n... /school/un...