A highly motivated, result oriented Big data Spark/ Hadoop architect/ Technical Lead/ hands-on Engineer. Design and lead complex enterprise integrated systems. Design and build real-time processing applications using Apache Spark/ Storm and Kafka. Design and build systems that collect, process, store, and analyze terabytes and petabytes of data. Drive the batch processes using Apache Oozie. Design and build real-time systems that process the requests in milliseconds. Possess strong leadership, cross-organizational partnerships, goal oriented attitude, effective communication and Agile project management skills. Delivered the applications on time and on planned budget. Specialties : Java, Scala, Spark, Python, SQL, AWS, working with very large data sets using Hadoop, Hive, Pig, Impala and Oozie, Elastic Search, Kibana, Solr, HBase, Storm, Kafka, Cassandra, Vertica, Spring, Hibernate, Dropwizard, Git, UNIX, Oracle, MySQL and more.

Big data Architect/ Engineer @ - Build real-time streaming applications using Spark/ Scala - Build Spark batch applications and run in Oozie - Setup YARN cluster for running Spark/ MapReduce/ Hive applications - Save the data in Parquet/ Text and query using Hive - Setup Apache Ignite and add in-memory data from Spark streaming application - Implemented PageRank and Neighborhood Aggregation in Spark GraphX - Setup SolrCloud cluster From April 2015 to Present (9 months) Sr. Data Engineer @ Worked in Machine Learning team. Worked on Petabyte scale. - Built real-time Storm based streaming application to run Segment evaluation using multilang protocol - Designed and Implemented ETL pipelines to produce rich derived data sources from raw text data on Amazon S3 using Oozie workflow, ETLs using Hive, data converted to ORC format in Cloudera CDH distribution, on-demand elastic cluster like Qubole, scripts using Python and other technologies - Worked closely with Data scientists and part of Machine Learning team - Built Java application using Spring, Quartz and JDBI to perform health checks on the data in Vertica and raise Nagios alerts when it exceeds thresholds From November 2013 to March 2015 (1 year 5 months) Technical Lead @ Architect and Lead for number of critical cross-domain Service-Oriented Architecture (SOA), Enterprise Application Integration (EAI) and Business Process Management (BPM) applications, using variety of Java technologies. From November 2000 to November 2013 (13 years 1 month) Software Engineer @ Java/ J2EE From May 2000 to October 2000 (6 months) Software Engineer @ Java and others. From March 1998 to March 2000 (2 years 1 month)

B.E., Engineering @ Madurai Kamaraj University, Madurai, IndiaPost Graduate Diploma in Computer Applications @ Wotec, Hyderabad, IndiaMachine Learning @ Stanford University /CourseraR Programming @ Coursera/ Johns Hopkins University Rajan Rajendran is skilled in: Unix, Java, Java Enterprise Edition, Hadoop, Amazon Web Services (AWS), Python, Oracle, SOA, Apache Spark, Enterprise Software, Agile Methodologies, Spring, Hive, Oozie, Tomcat