Here are a bunch of Technical / Non-Technical topics that I came across recently and found them very resourceful. Technical : The cost crisis in the observability space is a real problem. Here is an article that describes the issue: – link here How many conferences are too many? Here is an exhaustive list of all the popular talks on Kubernetes from 2023: – link here OpenTelemetry is the industry standard in observability. Here is a list of anti-patterns with observability to avoid:- link here Here is a write-up on a framework for data sharing between microservices – link here GoDaddy Data Pla ..read more

Here are a bunch of Technical / Non-Technical topics that I came across recently and found them very resourceful. Technical : System Design – Designing a Ticket Booking Site Like Ticketmaster is the most common system design question – link UberEngineering blog on Anomaly detection and alerting system – link P99 CONF 2023 | Always-on Profiling of All Linux Threads by Tanel Poder – YouTube link On choosing Golang as a programming language at American Express- link [Gold] : Best Papers awarded in Computer Science – sorted Yearly and Topic wise – link Writing an Engineering Strategy – link “If ..read more

In this write up, we will try and explore how to make the most out of the resources in K8s cluster for the Pods on them. Resource Types: When it comes to resources on Kubernetes cluster, they can be fairly divided in to two categories: compressible: If the usage of this resource for an application goes beyond the max, it can be throttled without directly killing the application/process. example : cpu – if a container consumes too much of compressible resource, they are throttled non-compressible: If the usage of this resource goes beyond max, it cannot be directly throttled. Might lead to ..read more

[Self Notes and Review]: This is a second writeup in the series of reading DDIA book and publishing my notes from the book. The first one can be found here This particular article is from the second chapter of the book. Again, these are just my self notes/extracts and treat this more like an overview/summary. Best way is to read the book in itself. This chapter dwells in to the details of: the format in which we write data to databases and mechanism by which we read it back. First – a few terminologies: Relational Database – which has rows and columns and a schema for all the data Eg: SQL ..read more

Here are a bunch of Technical / Non-Technical topics that I came across recently and found them very resourceful. Technical : The shortest and comprehensive System Design Template for any new service – link here Kafka is one of the most efficiently built transient datastore. This article explains the compute and storage layers of kafka — link here Consistent Hashing has helped solve Distributed System with: even shard distribution across nodes in cluster minimum data movement on adding/removing nodes from the cluster A great explaination of consistent hashing on the link here Picking a dat ..read more

Here are a bunch of Technical / Non-Technical topics that I came across recently and found them very resourceful. Technical : AI-Powered Search and Chat for AWS Docs. The best way of consuming AWS docs. — link here A Framework for Thinking About Systems Change – link here BookWyrm – Yet another attempt on building a social media based on book. link here git repo for the same – bookwyrm​ Built by Mouse Reeve – https://github.com/mouse-reeve a lovely side project from Mouse Reeve on building Maps – Youtube link Applying new hardware advancements and benchmarking variants of old databases ..read more

[Self Notes and Review]: This is a new series of publications where I am publishing my self notes/extracts from reading the very famous book – DDIA (Designing Data-Intensive Applications) by Martin Kleppmann. This particular article is from the first chapter of the book. Again, these are just my self notes/extracts and treat this more like an overview/summary. Best way is to read the book in itself. Side note: I am a terribly slow and repetitive reader. The update between chapters might take weeks. Reliable, Scalable and Maintainable Applications CPU not a constrain any more in computing. CPU ..read more

Here are a bunch of Technical / Non-Technical topics that I came across recently and found them very resourceful. Technical : Don’t turn that Swap off yet. In defense of swap – common misconceptions. – link here Why histogram and how are they useful. link here If you have used any of the monitoring or APM tools, you would have come across Histogram form of metric being emitter. This writeup give a brief on why Histogram. S3 isn’t getting cheaper – link here [Podcast- 35mins]: Moving from CEO back to IC – with Mitchell Hashimoto, cofounder of HashiCorp — link here Inside Datadog’s ..read more

Here are a bunch of Technical / Non-Technical topics that I came across recently and found them very resourceful. Technical : A new book released on the hot eBPF – “Learning eBPF” by Liz Rice. This a summary form and a quick introduction to eBPF capabilities when compared to “BPF Performance tools” by Brendan Gregg. To understand latency in detail – “Everything You Know About Latency Is Wrong” – link here Why Percentiles Don’t Work the Way You Think ? Reason to stop using Average value of metrics and how percentiles work. Link here Here is a detailed and partical resource on System Design ..read more

Here are a bunch of Technical / Non-Technical topics that I came across recently and found them very resourceful. Technical : It is December and Advent of code is here. What is Advent of code ? – link here. An old podcast on Spotify’s Engineering team geeking out every December on AOC – link here [A talk – 31mins ] – Concurrency is not Parallelism – “Concurrency is about dealing with lots of things at once. Parallelism is about doing lots of things at once.” – YouTube Observability is all about Metrics, Events, Logs and Traces [MELT]. The four core metrics types explained ..read more