Software Engineer · Distributed Systems
Amit Verma
Backend engineer · Kafka, IoT, distributed systems. I write long-form posts the same way I debug: what broke first, what tradeoff you pay, what shipped in production.
At work: 10k+ WebSocket connections, Kafka-scale pipelines, ClickHouse / Mongo / Redis — real constraints, not demos. I also keep DSA sharp with LeetCode (~1,000 problems solved · contest rating ~1,577 (~top 27% globally)).
iot-filtering-problem.js
// Real problem I solved at work
// User has 1 lakh device IDs → filter MongoDB
// ❌ Approach 1 — naive $in (100k IDs)
db.device_data.find({
device_id: { $in: deviceIds }
})
// Timeout. 4.2MB payload. Index dies.
// ❌ Approaches 2–6 also failed...
// ✅ Approach 7 — store ancestry at ingestion
db.device_data.find({
"ancestor_nodes.id": {
$in: ["N2", "N6"] // 2 IDs, not 100k
},
temperature: { $gt: 30 }
})
// ✅ 38ms. Works at any scale.