软件学院School of Software

Hybrid Transaction and Analytics Processing (HTAP): State of the Art

IBM Fellow, IBM Almaden Research Center (San Jose, USA)

Distinguished Visiting Professor, Tsinghua University (Beijing, China)

Abstract: Traditionally, database processing has been broadly classified into two categories: online transaction processing (OLTP) and online analytical processing (OLAP). OLTP systems preceded the emergence of relational database management systems (RDBMSs). OLAP, which was enabled by the arrival of RDBMSs and SQL, and enhancements to them, has gained even more attention in the last decade or so with the emergence of column stores and Big Data technologies like Map/Reduce, Hadoop and Spark. Data generated by OLTP systems are periodically moved in a batched fashion into OLAP systems for analytical processing.  In the last few years, increasingly organizations want to be able to base their decisions on the latest set of raw data and the real-time analytics derived from them. This has meant that the capabilities of OLTP and OLAP have had to be combined in a single system with essentially a single copy of the data being used for both purposes. The term HTAP is being used to refer to such Hybrid Transaction and Analytics Processing systems. Currently, there is intense focus on HTAP systems in industry and academia. In this talk, I will discuss the problems, technologies and systems that relate to HTAP. 

Earlier versions of this talk have been given as a keynote during the BIRTE 2016 conference held in conjunction with VLDB 2016 and in the ACM SIGMOD China Workshop held in conjunction with the 33rd Chinese National Database Conference (NDBC 2016).

Dr. C. Mohan is currently an IBM Fellow at the IBM Almaden Research Center in Silicon Valley and a Distinguished Visiting Professor at Tsinghua University in China. He joined IBM Research (San Jose, California) in 1981 where he worked until May 2006 on a number of topics in the areas of database, workflow and transaction management. From June 2006, he worked as the IBM India Chief Scientist, based in Bangalore, with responsibilities that relate to serving as the executive technical leader of IBM India within and outside IBM. In February 2009, at the end of his India assignment, Mohan resumed his research activities at IBM Almaden. Mohan is the primary inventor of the well-known ARIES family of database recovery and concurrency control methods, and the industry-standard Presumed Abort commit protocol. He was named an IBM Fellow, IBM's highest technical position, in 1997 for being recognized worldwide as a leading innovator in transaction management. In 2009, he was elected to the US National Academy of Engineering (NAE) and the Indian National Academy of Engineering (INAE). He received the 1996 ACM SIGMOD Innovations Award in recognition of his innovative contributions to the development and use of database systems. In 2002, he was named an ACM Fellow and an IEEE Fellow. At the 1999 International Conference on Very Large Data Bases, he was honored with the 10 Year Best Paper Award for the widespread commercial, academic and research impact of his ARIES work which has been extensively covered in textbooks and university courses. From IBM, Mohan has received 2 Corporate and 8 Outstanding Innovation/Technical Achievement Awards. He is an inventor on 50 patents and was named an IBM Master Inventor in 1997. Mohan works very closely with numerous IBM product and research groups, and his research results are implemented in numerous IBM and non-IBM prototypes and products like DB2, MQSeries, WebSphere, Informix, Cloudscape, Lotus Notes, Microsoft SQLServer and System Z Parallel Sysplex. He is currently focused on Blockchain, Big Data and HTAP technologies (http://bit.ly/CMbcDB, http://bit.ly/CMgMDS). For 2 years, he has been an evangelist for private blockchains and the myth buster of public blockchains. Since August 2016, he has been a Distinguished Visiting Professor of China’s prestigious Tsinghua University. He has been on the advisory board of IEEE Spectrum and has been an editor of VLDB Journal, and Distributed and Parallel Databases. He is currently a member of the Academy Leadership Team of the IBM Academy of Technology. In the past, he has been a member of IBM's Research Management Council (RMC), IBM's Technical Leadership Team (TLT), IBM India's Senior Leadership Team, the Bharti Technical Advisory Council, the Academic Senate of the International Institute of Information Technology (IIIT) in Bangalore and the Steering Council of IBM's Software Group Architecture Board. Mohan received his PhD in computer science from the University of Texas at Austin in 1981. In 2003, he was named a Distinguished Alumnus of IIT Madras from which he received a B.Tech. in chemical engineering in 1977. Mohan is a frequent speaker in North America, Europe and Asia, and has given talks in 40 countries. He is very active on social media and has a huge following. More information can be found in the Wikipedia page at http://bit.ly/CMwIkP.