Engineering Notes
Featured Deep Dive
ARCHITECTURE
Oct 24, 2024
Implementing Distributed Tracing in High-Volume Mesh
A deep dive into how we migrated from siloed logging to a unified tracing architecture using OpenTelemetry and Jaeger, specifically addressing the overhead concerns in our latency-critical data plane.
Marcus Thorne
Senior Data Engineer
// System Architecture Blueprint
async function initTracing(config: MeshConfig) {
const provider = new TraceProvider({
serviceName: config.id,
exporter: new JaegerExporter({
endpoint: process.env.COLLECTOR_URL
}),
sampler: new ProbabilitySampler(config.sampleRate)
});
// Global Context Propagation
await provider.register();
console.log(`Tracing initialized for ${config.id}`);
}
What It Feels Like to Work Here
Experiences define us more than posters ever could.
DATA
5 min read
PostgreSQL Indexing: The Case for Partial Indexes
"Selective indexing on active states saved 200GB of disk space and boosted write speed."
Marcus Thorne
Senior Data Engineer
DATA
5 min read
PostgreSQL Indexing: The Case for Partial Indexes
"Selective indexing on active states saved 200GB of disk space and boosted write speed."
Marcus Thorne
Senior Data Engineer
DATA
5 min read
PostgreSQL Indexing: The Case for Partial Indexes
"Selective indexing on active states saved 200GB of disk space and boosted write speed."
Marcus Thorne
Senior Data Engineer
DATA
5 min read
PostgreSQL Indexing: The Case for Partial Indexes
"Selective indexing on active states saved 200GB of disk space and boosted write speed."
Marcus Thorne
Senior Data Engineer
DATA
5 min read
PostgreSQL Indexing: The Case for Partial Indexes
"Selective indexing on active states saved 200GB of disk space and boosted write speed."
Marcus Thorne
Senior Data Engineer
DATA
5 min read
PostgreSQL Indexing: The Case for Partial Indexes
"Selective indexing on active states saved 200GB of disk space and boosted write speed."
Marcus Thorne
Senior Data Engineer
Engineering is a conversation.
Whether you're exploring software architecture, distributed systems engineering, or platform engineering at scale, there's always more to discuss.