This presentation introduces the Big Data Engineering (BDE), which is defined as the practical application of a systematic, disciplined, quantifiable approach to the analysis, design, construction, operation, and maintenance of Big Data solutions. BDE is a holistic method focusing on 8 crucial areas: Methodology, Program, Governance, Resources, Quality, Risk Mitigation, KPI & Financials, and Practice. BDE also systematically addresses the lifecycle of Big Data solutioning in 12 stages: Plan, Requirement, Analysis, Modeling, Platform, Design, Development, Integration, Testing, Runtime, Deployment, and Operation. Each of these 12 stages comprises individual elements as subdisplines. For example, the NoSQL platform options include key-value, column-based, document-oriented, graph, NewSQL, and In-memory stores. Case studies and working examples will be discussed in great details in the session to illustrate the pragmatic use of BDE in the real-world implementations. Best practices and lessons learned are articulated as well.

Topics you will learn about include:

• Engineering discipline
• Lifecycle
• Methodology
• Governance
• Best practices