Data Analytics: The Big Data Analysis Process (BDAP) Architecture

J.A. Crowder
Colorado Engineering Inc., United States

Keywords: Big Data Analytics, Artificial Intelligence, Hypothesis-Driven Analytics

Analysis, characterization and classification of large, heterogeneous, complex data sets (the “Big Data” problem) has been a major source of R&D for decades. Current and future space, air, and ground systems are growing in complexity and capability, creating a serious challenge to operators who monitor, maintain, and utilize systems in an ever growing network of assets. The growing interest in autonomous systems with cognitive skills to monitor, analyze, diagnose and predict behaviors real time makes this problem even more challenging. Systems today continue to struggle with satisfying the need to obtain actionable knowledge from an ever increasing and inherently duplicative store of non-context specific, multi-disciplinary information content. Additionally, increased automation is the norm and truly autonomous systems are the growing future for atomic/subatomic exploration and within challenging environments unfriendly to the physical human condition. Simultaneously, the size, speed, and complexity of systems continue to increase rapidly to improve timely generation of actionable knowledge. Presented here are new concepts and notional architectures for a Big Data Analytical Process (BDAP) which will facilitate real-time cognition-based information discovery, ecomposition, reduction, normalization, encoding, memory recall (knowledge construction), and most importantly enhanced/improved decision making for big data systems.