Tenzaa's Tech Blog
This site is dedicated to sharing IT-related technologies.
Implementing Statistical Drift Detection for Incremental Hudi Ingests Using SciPy Pre-Commit Validators Implementing Statistical Drift Detection for Incremental Hudi Ingests Using SciPy Pre-Commit Validators
The operational alert at 2 AM wasn’t for a system crash, but for a data pipeline that had silently started poisoning a p
2023-10-27 Data Engineering
Apache Hudi SciPy ISR Spark Data Quality
Correlating GraphQL API Calls with Kernel-Level Events via an eBPF and Spark Pipeline Correlating GraphQL API Calls with Kernel-Level Events via an eBPF and Spark Pipeline
The GraphQL endpoint for our primary metadata service became a performance bottleneck. The P99 latency was unacceptable,
2023-10-27 Observability
Go Observability eBPF Scala OpenSearch GraphQL Apache Spark
Implementing a Declarative GPU Workspace Provisioner with Crossplane and a React Frontend Implementing a Declarative GPU Workspace Provisioner with Crossplane and a React Frontend
The computer vision team’s development loop was broken. Onboarding a new engineer involved a multi-day, documentation-he
2023-10-27 Cloud Native
Kubernetes Frontend Crossplane DevOps OpenCV IaC
Engineering a Cost-Effective Serverless NLP Inference Endpoint with spaCy Kong and AWS Lambda Engineering a Cost-Effective Serverless NLP Inference Endpoint with spaCy Kong and AWS Lambda
The mandate was straightforward: expose a Named Entity Recognition (NER) capability as a new internal microservice. The
2023-10-27 Cloud Architecture
MLOps spaCy Serverless AWS Lambda Kong
A Data Pipeline Architecture for Streaming Hadoop Warehouse Metrics to a Valtio Frontend via a Tornado WebSocket Layer A Data Pipeline Architecture for Streaming Hadoop Warehouse Metrics to a Valtio Frontend via a Tornado WebSocket Layer
The five-minute refresh interval on our Hadoop operational dashboards was untenable. During a cluster degradation event,
2023-10-27 Data Engineering
WebSockets JPA Hibernate Hadoop Tornado Data Warehouse Valtio
Implementing a Temporal Knowledge Graph via an NLP and Event Sourcing Pipeline on ArangoDB and Terraform Implementing a Temporal Knowledge Graph via an NLP and Event Sourcing Pipeline on ArangoDB and Terraform
The core problem wasn’t a lack of data, but a lack of history. Our existing knowledge graph, built from millions of inte
2023-10-27 Data Engineering
Python NLP Event Sourcing Terraform ArangoDB Architecture
26 / 34