Lab 20: Capstone — Enterprise Fintech Data

Time: 50 minutes | Level: Architect | DB: PostgreSQL, ClickHouse, Kafka, MongoDB, Redis, Elasticsearch

This capstone designs a complete enterprise data architecture for a fintech company processing payments, managing customer profiles, detecting fraud in real-time, and maintaining compliance audit trails. Every design decision is justified by regulatory requirements and operational constraints.


Step 1: Requirements & Architecture Decisions

Business context: A payment processing fintech serving 2M active users, processing 500K transactions/day ($50M daily volume), operating under PCI-DSS, GDPR, SOX, and AML regulations.

┌─────────────────────────────────────────────────────────────────────────────┐
│                    FINTECH ENTERPRISE DATA ARCHITECTURE                      │
│                                                                              │
│  ┌─────────────────────────────────────────────────────────────────────┐    │
│  │                         CLIENT TIER                                  │    │
│  │  Mobile Apps  │  Web App  │  Partner APIs  │  Internal Tools        │    │
│  └──────────────────────────────┬──────────────────────────────────────┘    │
│                                 │ HTTPS/TLS 1.3                             │
│  ┌──────────────────────────────▼──────────────────────────────────────┐    │
│  │  API Gateway (Kong/AWS) + WAF + Rate Limiting (Redis)               │    │
│  └──────┬─────────────────────────────────────────────────────────┬────┘    │
│         │                                                          │         │
│  ┌──────▼──────────────┐                              ┌───────────▼──────┐  │
│  │  TRANSACTION CORE   │                              │  FRAUD ENGINE    │  │
│  │  PostgreSQL Primary │◄──── PgBouncer (pool) ──────►│  Redis Cluster   │  │
│  │  + 2 Read Replicas  │                              │  ML Scoring      │  │
│  └──────┬──────────────┘                              └──────────────────┘  │
│         │ WAL / CDC (Debezium)                                              │
│  ┌──────▼──────────────────────────────────────────────────────────────┐    │
│  │                    KAFKA EVENT HUB (3 brokers)                       │    │
│  │  Topics: transactions | fraud.alerts | user.events | audit.log       │    │
│  └──────┬────────────┬────────────┬────────────┬───────────────────────┘    │
│         │            │            │            │                             │
│  ┌──────▼──┐  ┌──────▼──┐  ┌─────▼──┐  ┌──────▼──────────┐                │
│  │ClickHse │  │MongoDB  │  │Elastic │  │  Compliance DB  │                │
│  │Analytics│  │Profiles │  │ Search │  │  (PostgreSQL)   │                │
│  └─────────┘  └─────────┘  └────────┘  └─────────────────┘                │
└─────────────────────────────────────────────────────────────────────────────┘

Technology selection matrix:

Component
Technology
Justification

OLTP Core

PostgreSQL 15

ACID, PCI-DSS, mature ecosystem, PITR

Connection Pool

PgBouncer

Handle 10K concurrent users on 50 PG connections

Fraud Detection

Redis Cluster

Sub-millisecond scoring, sliding window counters

Customer Profiles

MongoDB Atlas

Flexible schema, nested documents, global sync

Analytics

ClickHouse

Columnar, 1B rows/sec scan for real-time dashboards

Event Streaming

Apache Kafka

Durability, replay, fan-out to all consumers

Audit Search

Elasticsearch

Full-text compliance search, 7-year retention


Step 2: Core OLTP Schema — PostgreSQL


Step 3: Fraud Detection — Redis Cluster


Step 4: Migration Strategy — Flyway


Step 5: Monitoring Queries


Step 6: Compliance Checklist Architecture


Step 7: Cost Estimate Table


Step 8: Capstone — Architecture Report Generator

Run verification:

📸 Verified Output:


Summary

Capability
Solution
SLA

Transaction processing

PostgreSQL Primary + PgBouncer

99.99% uptime, <10ms p99

Read scaling

2 PostgreSQL read replicas

3× read throughput

Fraud detection

Redis Cluster sliding window counters

<5ms scoring

Customer profiles

MongoDB Atlas

99.995% (multi-region)

Analytics

ClickHouse columnar cluster

<100ms for 1B row scans

Event streaming

Kafka 3-broker cluster

99.95%, replay capability

Compliance search

Elasticsearch 3-node cluster

7-year retention, <50ms

Connection pooling

PgBouncer transaction mode

1000 clients → 50 PG conns

Schema migrations

Flyway with version control

Zero-downtime patterns

Data governance

PII vault + RLS + audit_log

GDPR Art. 17 + SOX 7yr

Cost (annual)

Reserved instance pricing

~$90,000-114,000/yr

Compliance

PCI-DSS, GDPR, SOX, AML

All controls implemented

Congratulations — you've completed the Database Architect learning path!

You can now design, optimize, secure, and govern enterprise-scale data platforms. The skills from these 20 labs apply directly to real-world systems serving millions of users across multiple regulatory jurisdictions.

Last updated