deploy: 5e0d548

index.xml

@@ -3,13 +3,13 @@ Why ELK wasn’t the right fit for us In 2018, we adopted the ELK stack as our d
 This post covers our journey and experiences with each of the frameworks, and why we finally bet on Flutter even when it was bleeding edge alpha technology.</description></item><item><title>Scaling with common sense #2: Being future ready.</title><link>https://zerodha.tech/blog/being-future-ready-with-common-sense/</link><pubDate>Wed, 28 Jul 2021 15:30:00 +0530</pubDate><guid>https://zerodha.tech/blog/being-future-ready-with-common-sense/</guid><description>Over the last year, owing to the unexpected rally in capital markets, Zerodha&amp;rsquo;s customer base has more than tripled, significantly increasing the number of concurrent users on our platforms along with the traffic and load they generate on numerous systems in the background. For context, in January 2020, we were handling 2+ million retail trades daily. In April 2020, it had risen to 7+ million. Today, it goes up to 12+ million.</description></item><item><title>Working with PostgreSQL</title><link>https://zerodha.tech/blog/working-with-postgresql/</link><pubDate>Thu, 22 Apr 2021 00:00:00 +0530</pubDate><guid>https://zerodha.tech/blog/working-with-postgresql/</guid><description>This post is in the context of the large, data heavy PostgreSQL instances that store historical transactional data and reports, the databases that power Console and its large scale number crunching and reporting. It talks about how we self-host, tune, and manage all our DB instances on bare EC2 instances. For high availability and backups, we use simple failover replicas and for backups, AWS disk snapshots.
 The Console DBs store hundreds of billions of rows of different kinds of financial and transactional data, currently close to 20 TB, across four sharded nodes.</description></item><item><title>A lesson in creating and using niche business DSLs at scale</title><link>https://zerodha.tech/blog/a-lesson-in-niche-business-dsls-at-scale/</link><pubDate>Tue, 24 Nov 2020 17:35:00 +0530</pubDate><guid>https://zerodha.tech/blog/a-lesson-in-niche-business-dsls-at-scale/</guid><description>At Zerodha, we process millions of trades in real-time, where each trade comes into the system as concurrent high throughput HTTP requests. Each trade increases the latency for subsequent orders in the queue that are under processing at the same time at our OMS (Order Management System). When a single order comes through to the OMS, it goes through a bunch of computationally intensive validations and adds to the latency. To reduce the latency of orders, we decided to offload some of these business validations from the OMS into an external component called Veto, which pre-validates incoming orders based on custom dynamic rules set by our Risk Management team.</description></item><item><title>Alar: The making of an open source dictionary</title><link>https://zerodha.tech/blog/alar-the-making-of-an-open-source-dictionary/</link><pubDate>Tue, 22 Sep 2020 00:00:00 +0530</pubDate><guid>https://zerodha.tech/blog/alar-the-making-of-an-open-source-dictionary/</guid><description>ನಮಸ್ಕಾರ (Namaskāra)! This is not a post on fintech, or even technology for that matter. This is the story of a product of tenacity, selflessness, and passion; a product that will transcend and outlive most technology we know of. This is the story of a massive dictionary that will become the window to a language spoken by tens of millions of people for generations to come, a resource its author has donated to posterity.</description></item><item><title>Scaling with common sense</title><link>https://zerodha.tech/blog/scaling-with-common-sense/</link><pubDate>Sun, 14 Jun 2020 14:00:00 +0530</pubDate><guid>https://zerodha.tech/blog/scaling-with-common-sense/</guid><description>&amp;ldquo;Scaling&amp;rdquo; is not a specific technique but an entire spectrum that stretches all the way from &amp;ldquo;Google scale&amp;rdquo; to the K8s cluster Karan runs on a Raspberry Pi plugged into a 12V shaver outlet in his bathroom to encrypt his DNS queries for peak privacy, while he asks Alexa to dim the lights and play his favorite non-mainstream indie music.
 It is a collection of practices unique and intimate to every organisation, and is the product of an infinite number of variables; the numerous domain-specific problems, the structure of the organisation, the nature of the people involved and their biases, countless engineering decisions and trade-offs, technical debt and history, ad infinitum.</description></item><item><title>Infrastructure monitoring with Prometheus at Zerodha</title><link>https://zerodha.tech/blog/infra-monitoring-at-zerodha/</link><pubDate>Mon, 27 Apr 2020 00:00:00 +0530</pubDate><guid>https://zerodha.tech/blog/infra-monitoring-at-zerodha/</guid><description>On any given day, we handle around 15% of daily retail trading volume across all stock exchanges in India. Billions of requests generated in the process are handled by a suite of systems we have built in-house. Also, we are very particular on self-hosting as many dependencies as possible, everything from CRMs to large databases, Kafka clusters, mail servers etc.
-To aid these primary systems, there are a large number of ancillary workloads that run, covering everything from real-time trades, document processing, KYC, and account opening, legal and compliance, complex, large scale P&amp;amp;L and number crunching, and a wide range of backoffice workloads.</description></item><item><title>Hello, World!</title><link>https://zerodha.tech/blog/hello-world/</link><pubDate>Mon, 06 Apr 2020 00:00:00 +0530</pubDate><guid>https://zerodha.tech/blog/hello-world/</guid><description>Zerodha, now India&amp;rsquo;s largest stock broker, bootstrapped and profitable, turns ten years old this year. The Zerodha tech team turns seven years old. The tech team has remained largely elusive over the course of our existence. While we have pondered starting a tech blog for more than half a decade, we have often found ourselves too busy building the fundamental blocks underlying a stock brokerage. We have also been stalled by a sense of unpreparedness to talk to the world about our very unconventional setup.</description></item><item><title>Projects</title><link>https://zerodha.tech/projects/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://zerodha.tech/projects/</guid><description>listmonk ★ 14202
+To aid these primary systems, there are a large number of ancillary workloads that run, covering everything from real-time trades, document processing, KYC, and account opening, legal and compliance, complex, large scale P&amp;amp;L and number crunching, and a wide range of backoffice workloads.</description></item><item><title>Hello, World!</title><link>https://zerodha.tech/blog/hello-world/</link><pubDate>Mon, 06 Apr 2020 00:00:00 +0530</pubDate><guid>https://zerodha.tech/blog/hello-world/</guid><description>Zerodha, now India&amp;rsquo;s largest stock broker, bootstrapped and profitable, turns ten years old this year. The Zerodha tech team turns seven years old. The tech team has remained largely elusive over the course of our existence. While we have pondered starting a tech blog for more than half a decade, we have often found ourselves too busy building the fundamental blocks underlying a stock brokerage. We have also been stalled by a sense of unpreparedness to talk to the world about our very unconventional setup.</description></item><item><title>Projects</title><link>https://zerodha.tech/projects/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://zerodha.tech/projects/</guid><description>listmonk ★ 14385
 High performance, self-hosted, newsletter and mailing list manager with a modern dashboard. Single binary app.
-koanf ★ 2569
+koanf ★ 2608
 Simple, extremely lightweight, extensible, configuration management library for Go. Support for JSON, TOML, YAML, env, command line, file, S3 etc. Alternative to viper.
 csvtotable ★ 1109
 Simple command-line utility to convert CSV files to searchable and sortable HTML table.
-dungbeetle ★ 453</description></item><item><title>Zerodha's FOSS stack</title><link>https://zerodha.tech/stack/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://zerodha.tech/stack/</guid><description>Languages Go
+dungbeetle ★ 471</description></item><item><title>Zerodha's FOSS stack</title><link>https://zerodha.tech/stack/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://zerodha.tech/stack/</guid><description>Languages Go
 Python
 Java
 JavaScript