Tenzaa's Tech Blog
This site is dedicated to sharing IT-related technologies.
  Post Categories
Data Engineering 27 Architecture 25 Web Architecture 2 Observability 24 MLOps 16 Cloud Native 11 Distributed Systems 28 Software Architecture 4 MLOps Engineering 1 Backend Architecture 2 Backend Development 8 DevOps 21 System Design 6 System Architecture 4 DevSecOps 4 Mobile Development 2 Security 3 Cloud Security 2 Full-Stack Development 1 Cloud Architecture 3 Security Engineering 1 Platform Engineering 1 WebAssembly 1 Serverless 1 Software Engineering & Architecture 1 Real-Time Communication 1
Implementing Serverless Backpressure for an iOS Telemetry Ingestion Pipeline from Kafka to ScyllaDB Implementing Serverless Backpressure for an iOS Telemetry Ingestion Pipeline from Kafka to ScyllaDB
Our initial iOS telemetry pipeline was a textbook example of a system that worked perfectly in staging but crumbled unde
2023-10-27 Data Engineering
Kafka iOS ScyllaDB Pulumi Google Cloud Functions Backpressure
Implementing a Tiered Storage Strategy for Distributed Feed Ingestion Using Java SQLite and Cassandra Implementing a Tiered Storage Strategy for Distributed Feed Ingestion Using Java SQLite and Cassandra
The monolith feed ingestion system buckled at around 10,000 active feeds. The central PostgreSQL database, once a reliab
2023-10-27 Data Engineering
Cassandra Loki Java SQLite Rome
Implementing a Resilient CDC Pipeline from PostgreSQL to ClickHouse with a Spring Boot Processor Implementing a Resilient CDC Pipeline from PostgreSQL to ClickHouse with a Spring Boot Processor
The analytics team’s daily reports were consistently late. Our legacy ETL process, a collection of batch scripts running
2023-10-27 Data Engineering
CDC Debezium Kafka Software Engineering & Architecture Spring Boot ClickHouse Data Warehouse
Implementing Exactly-Once Semantics for a Data Ingestion Pipeline Using XState and a Transactional Delta Lake State Store Implementing Exactly-Once Semantics for a Data Ingestion Pipeline Using XState and a Transactional Delta Lake State Store
The core failure mode was subtle but catastrophic for our analytics. Our IoT telemetry ingestion service, running on a D
2023-10-27 Data Engineering
Delta Lake DigitalOcean InfluxDB Caddy XState
Implementing a LlamaIndex HDFS Reader for Real-time RAG on a Legacy Big Data Cluster Implementing a LlamaIndex HDFS Reader for Real-time RAG on a Legacy Big Data Cluster
The project mandate was deceptively simple: unlock decades of institutional knowledge trapped in our on-premise Hadoop c
2023-10-27 Data Engineering
Emotion Vector LlamaIndex Vite Hadoop
Implementing Transactional Feature Rollups in MongoDB for Real-Time Machine Learning Inference Implementing Transactional Feature Rollups in MongoDB for Real-Time Machine Learning Inference
The correctness of a real-time machine learning system, particularly in domains like financial fraud detection or credit
2023-10-27 Data Engineering
ACID Rollup OCI TensorFlow MongoDB
3 / 5