Shikharesh Majumdar
Carleton University, Canada
Title: High-performance data analytics: Platforms, resource management, and middleware
Biography
Biography: Shikharesh Majumdar
Abstract
Enterprises, social networks and smart systems that leverage the Internet of Things technology often lead to large datasets. Data analytics concerns the extraction of knowledge from such raw data. The challenges underlying the processing of such data sets are captured in the 3V characteristics of BigData: Volume, Velocity, and Variety. The first refers to the large size of stored data sets, the second to data in motion streaming from social networks or sensor-based smart systems for example while the third concerns the large variety in data types and formats. High-performance computing platforms such as clusters and clouds are often deployed to address these challenges. Enabling technology that includes parallel processing frameworks and platforms, as well as algorithms for the management of resources in the cloud/cluster, is crucial for performing data analytics in a timely manner. Focusing on such enabling technology this talk will address the various challenges and potential solutions in the context of cloud-based systems for supporting Big Data analytics and smart systems. Issues to be discussed include (a) Management of resources in the context of latency-sensitive data analytics applications such as deadline driven MapReduce jobs and mobile object tracking (video analytics) algorithms. (b) Scheduling techniques for supporting streaming data analytics. (c) Edge-computing based platforms for performing complex event processing in the context of sensor-based streaming applications such as remote patient monitoring. (d) A cloud-based middleware for the unification of geographically dispersed resources required in the management of smart systems such as sensor-based bridges and aerospace machinery.