Tenzaa's Tech Blog
This site is dedicated to sharing IT-related technologies.
  Post Categories
Data Engineering 27 Architecture 25 Web Architecture 2 Observability 24 MLOps 16 Cloud Native 11 Distributed Systems 28 Software Architecture 4 MLOps Engineering 1 Backend Architecture 2 Backend Development 8 DevOps 21 System Design 6 System Architecture 4 DevSecOps 4 Mobile Development 2 Security 3 Cloud Security 2 Full-Stack Development 1 Cloud Architecture 3 Security Engineering 1 Platform Engineering 1 WebAssembly 1 Serverless 1 Software Engineering & Architecture 1 Real-Time Communication 1
A Data Pipeline Architecture for Streaming Hadoop Warehouse Metrics to a Valtio Frontend via a Tornado WebSocket Layer A Data Pipeline Architecture for Streaming Hadoop Warehouse Metrics to a Valtio Frontend via a Tornado WebSocket Layer
The five-minute refresh interval on our Hadoop operational dashboards was untenable. During a cluster degradation event,
2023-10-27 Data Engineering
WebSockets JPA Hibernate Hadoop Tornado Data Warehouse Valtio
Securing Multi-Tenant Spark Workloads with Dynamically Generated Cilium Policies via OAuth 2.0 Securing Multi-Tenant Spark Workloads with Dynamically Generated Cilium Policies via OAuth 2.0
The technical pain point was stark: our shared Kubernetes cluster for running Apache Spark jobs had become a security li
2023-10-27 Data Engineering
Kubernetes Security Java OAuth 2.0 Cilium Apache Spark
Implementing a Temporal Knowledge Graph via an NLP and Event Sourcing Pipeline on ArangoDB and Terraform Implementing a Temporal Knowledge Graph via an NLP and Event Sourcing Pipeline on ArangoDB and Terraform
The core problem wasn’t a lack of data, but a lack of history. Our existing knowledge graph, built from millions of inte
2023-10-27 Data Engineering
Python Event Sourcing NLP Terraform ArangoDB Architecture
Engineering a Resilient Oracle Change Data Stream Processor Using Dask and WebSockets Engineering a Resilient Oracle Change Data Stream Processor Using Dask and WebSockets
The core problem was a familiar one: a monolithic Oracle database, hammered by thousands of transactions per second, hel
2023-10-27 Data Engineering
CDC Python WebSockets Dask Oracle Distributed Computing
Implementing Statistical Drift Detection for Incremental Hudi Ingests Using SciPy Pre-Commit Validators Implementing Statistical Drift Detection for Incremental Hudi Ingests Using SciPy Pre-Commit Validators
The operational alert at 2 AM wasn’t for a system crash, but for a data pipeline that had silently started poisoning a p
2023-10-27 Data Engineering
Apache Hudi SciPy ISR Spark Data Quality
Constructing a Resilient Data Pipeline from TiDB to Snowflake Using Quarkus and Redis Streams Constructing a Resilient Data Pipeline from TiDB to Snowflake Using Quarkus and Redis Streams
The core operational database, a sharded MySQL cluster, was buckling under the strain of analytical queries. Every ad-ho
2023-10-27 Data Engineering
TiDB Redis Streams CQRS Data Pipeline Jenkins Snowflake Quarkus
4 / 5