- 11+ years of IT experience, an experienced Big Data hands-on technologist, excellent track records in providing technical solutions to the business requirements and in managing medium size projects in Mainframe, Java/J2EE and Big Data Technologies space.
- 2+ years of experience in architecting and developing solution using Big Data technologies like Hadoop, MapReduce, Pig, Hive, HBase, Elasticsearch, Talend. Very good understanding of OLTP & OLAP system architecture.
- Have good knowledge on Data Warehousing concepts and expertise in building ETL processes using Pig, Hive. Expertise in building UDFs.
- Expertise in HBase schema design and building RESTful API to expose data to consumers
- Good understanding of Search Engines and hands on experience with Elasticsearch - indexing data and building API to enable full text search on Big Data.
- Understanding of Recommendation Engine and Machine Learning algorithms and knowledge on Python & Mahout libraries
- Experience in building Geospatial, Temporal and Topical visualizations using Tableau to discover business intelligence from data
- Experience in designing and building to Real Time stream processing application to generate real time marketing offers using Storm
- Experience in developing Proof of Concept using Graph Database Neo4j
- Hands on experience on technologies like Spark, Kafka, Apache Drill, Platfora, Sqoop, Flume
- Good understanding of Data Structures and Algorithm in Java
- Good experience in UNIX Shell Scripting, Perl Scripting and Python
- Extensive experience in building solutions in Fraud, Privacy, Customer Marketing, AML areas in Financial and Credit Card domain
- Very good knowledge related to project release management, change management, build management and configuration management.
- Cloudera Certified Hadoop Developer (July 2013) and Certified Apache Spark Developer
Sr. Software Data Engineer @ Work with R&D team in AOL Platform Group in developing Large Scale Analytics data modeling and online advertising optimization systems. From October 2015 to Present (3 months) Sr. Big Data Engineer @American Express @ - Architecting and Developing solution on Hadoop echo system using HDFS, Mapreduce, Pig, Hive, HBase, Elasticsearch, Talend, Oozie
- Working on PoCs for Real Time Data processing using Storm and Graph Database Neo4j
- Experimenting with Apache Drill to support low latency queries and Platfora for data exploration
- Developing ETL process for data feeds from legacy systems using Talend From June 2013 to October 2015 (2 years 5 months) Phoenix, Arizona AreaTechnology Lead @ - Leading application development in Mainframe and Java/J2EE technologies in Fraud, Privacy, Customer Marketing and AML space From November 2007 to May 2013 (5 years 7 months) Phoenix, Arizona AreaSoftware Engineer @ From July 2004 to October 2007 (3 years 4 months) Pune Area, India
Master's Degree, Data Science @ Indiana University Bloomington From 2015 to 2016 Bachelor of Engineering (BE), Electronics Engineering, First Class with Distinction @ NIT, Surat From 1999 to 2003 Barasat Govt School Dipankar Biswas is skilled in: DB2, Hadoop, Requirements Analysis, Requirements Gathering, SOA, Apache Pig, Hive, Java Enterprise Edition, Core Java, Software Project Management, Agile Methodologies, MapReduce, Data Warehousing, JCL, SQL