Staff Software Engineer at eBay
San Jose, California, United States
A challenging position utilising my experience and skills in creative thinking to assist business in new product creation, development and promotion.Senior Software Engineer(Expert) @ Lead in designing and developing a robust backend infrastructure framework. It supports automatic creation of real-time denormalized index data for both Cassandra cluster and Elasticsearch cluster.
A challenging position utilising my experience and skills in creative thinking to assist business in new product creation, development and promotion.Senior Software Engineer(Expert) @ Lead in designing and developing a robust backend infrastructure framework. It supports automatic creation of real-time denormalized index data for both Cassandra cluster and Elasticsearch cluster.
This framework includes five core components:
- A core code processor engine based on Java annotation processor, Mustache and Antlr. It will generate denormalized index related Java classes automatically.
- A real-time online job based on Spark streaming with Kafka and an offline job based on Spark. The online job will generate real-time indices for Cassandra and Elasticsearch; The offline job will run index data migration operation and index data repair operation.
- A core message queue library based on Apache Kafka.
- A core serialization library based on Kryo.
- A core maven plugin which is an automatic job generator based on ASM(Java bytecode analysis library) and Maven
Lead in designing Rabbitmq cluster architecture, in order to improve system response speed, decouple the different project modules and support offline job. Make API response 2-3 times faster than before.
Lead in optimizing cloud-based email retrieval system, to support quick full text retrieval from more than 1 billion existing emails, and 0.7 million daily increasing mail indices.
Research and design new architecture for multilingual email retrieval, especially improve the accuracy and speed of mixed-language email retrieval. Research on Solr and Lucene source code in-depth, designed custom multilingual text analyzer component. This new architecture can improve query speed 2-4 times faster on average than old Solr architecture.
Optimize index build process in-depth between Cassandra and Solr cloud, design and implement a grand new architecture for this build process, using Hadoop and custom SSTable export tool to convert SSTable data to Solr documents, and update these data to Solr Cloud directly. From February 2014 to Present (1 year 11 months) Software Engineer @ Design and develop an enterprise mail system, based on Cassandra cluster and Nginx, ELB load balancing technology, which can support huge business throughput of around 3000 employees' business gracefully.
Design and develop email retrieval system with Solr cloud technology; integrate Solr cloud and Cassandra, which makes full text query and index performance more powerful.
Design and develop a new file system to make this enterprise mail system more versatile, which is based on Amazon S3 and file reference counting algorithm. In addition to the basic file management operations, it supports many advanced features, such as file sharing and file private link. From August 2012 to February 2014 (1 year 7 months) Shanghai City, ChinaSoftware Engineer Intern @ Design and develop a power monitor system to control powercycles of more than 1000 devices in the network lab, based on Mysql cluster, which uses SNMP, Telnet and socket protocol to control powercycles. Integrate this system with Okcard system, Labkeeper system and Firebird system.
Design and develop an assets management system, using SNMP protocol, which implements the following functions: devices automatic retrieval, devices information reading, manual warehousing, importing the data as a batch, as well as generating the reports.
Responsible for configuring and managing team's network devices in the network lab. From July 2011 to April 2012 (10 months) Software Engineer Intern @ Develop KFC(keyword filter center) system to reduce the request pressure of the CTU system, which consists of three main components: keyword management, keyword filtering and keyword sharing.
Develop CTU system which is the core product of Taobao's secuity team, including add new whitelist and blacklist features, integrate KFC system inside this system.
Develop parmirs-service system to guarantee the quality of goods and the right of the customers; define rules to punish the merchants who violate the regulations. From August 2009 to May 2010 (10 months) Master, Computer Science @ Dalian University of Technology From 2010 to 2012 Bachelor, Computer Science @ Dalian University of Technology From 2006 to 2010 Alan Zhang is skilled in: Linux, Java, Eclipse, JSP, C, Python, Shell Scripting, Solr, Cassandra, RESTful WebServices, RabbitMQ, Programming, MySQL, Zookeeper, Apache Wink
WORKS APPLICATIONS
Senior Software Engineer(Expert)
February 2014 to Present
WORKS APPLICATIONS
Software Engineer
August 2012 to February 2014
Shanghai City, China
Cisco Systems
Software Engineer Intern
July 2011 to April 2012
Alibaba.com
Software Engineer Intern
August 2009 to May 2010
Lead in designing and developing a robust backend infrastructure framework. It supports automatic creation of real-time denormalized index data for both Cassandra cluster and Elasticsearch cluster. This framework includes five core components: - A core code processor engine based on Java annotation processor, Mustache and Antlr. It will generate denormalized index related Java classes automatically. - A... Lead in designing and developing a robust backend infrastructure framework. It supports automatic creation of real-time denormalized index data for both Cassandra cluster and Elasticsearch cluster. This framework includes five core components: - A core code processor engine based on Java annotation processor, Mustache and Antlr. It will generate denormalized index related Java classes automatically. - A real-time online job based on Spark streaming with Kafka and an offline job based on Spark. The online job will generate real-time indices for Cassandra and Elasticsearch; The offline job will run index data migration operation and index data repair operation. - A core message queue library based on Apache Kafka. - A core serialization library based on Kryo. - A core maven plugin which is an automatic job generator based on ASM(Java bytecode analysis library) and Maven Lead in designing Rabbitmq cluster architecture, in order to improve system response speed, decouple the different project modules and support offline job. Make API response 2-3 times faster than before. Lead in optimizing cloud-based email retrieval system, to support quick full text retrieval from more than 1 billion existing emails, and 0.7 million daily increasing mail indices. Research and design new architecture for multilingual email retrieval, especially improve the accuracy and speed of mixed-language email retrieval. Research on Solr and Lucene source code in-depth, designed custom multilingual text analyzer component. This new architecture can improve query speed 2-4 times faster on average than old Solr architecture. Optimize index build process in-depth between Cassandra and Solr cloud, design and implement a grand new architecture for this build process, using Hadoop and custom SSTable export tool to convert SSTable data to Solr documents, and update these data to Solr Cloud directly.
What company does Alan Zhang work for?
Alan Zhang works for WORKS APPLICATIONS
What is Alan Zhang's role at WORKS APPLICATIONS?
Alan Zhang is Senior Software Engineer(Expert)
What industry does Alan Zhang work in?
Alan Zhang works in the Internet industry.
Who are Alan Zhang's colleagues?
Alan Zhang's colleagues are Carmen Orr, Senthil Padmanabhan, Nariman Riahi, Travis Young, ANNE HILL, Justin Lovric, Debarati Goswami, Dan Leiva, Terri DeAnzo, and Nivedita Kanakkoor
Enjoy unlimited access and discover candidates outside of LinkedIn
One billion email addresses and counting
Everything you need to engage with more prospects.
ContactOut is used by
76% of Fortune 500 companies