Tagged | scaling
-
Presentation: How Facebook Is Bringing QUIC to Billions
(www.infoq.com) -
Improving Reliability: Building a Vitess Balancer to Minimize MySQL Downtime
(product.hubspot.com) -
Designing Instagram
(highscalability.com) -
Designing WhatsApp
(highscalability.com) -
Pinterest Druid Holiday Load Testing
(stackshare.io) -
Presentation: Robust Foundation for Data Pipelines at Scale - Lessons from Netflix
(www.infoq.com) -
From 0 to 20 billion - How We Built Crawler Hints
(blog.cloudflare.com) -
Pinterest Druid Holiday Load Testing
(medium.com) -
General and Scalable Parallelization for Neural Networks
(ai.googleblog.com) -
What is Connection Pooling, and Why Should You Care
(www.cockroachlabs.com) -
eBay’s Global Secondary Indexes
(tech.ebayinc.com) -
MemQ: An Efficient, Scalable Cloud Native PubSub System
(stackshare.io)#software-architecture #scaling #distributed-systems #cloud #pubsub
-
Scaling an Alerting Service Using AWS Lambda Functions
(engineering.salesforce.com) -
MemQ: An efficient, scalable cloud native PubSub system
(medium.com)#software-architecture #scaling #distributed-systems #data-engineering
-
Scaling Apache Druid for Real-Time Cloud Analytics at Confluent
(www.confluent.io) -
Presentation: Building and Scaling a Control Plane for 1000s of Kafka Clusters
(www.infoq.com) -
Netflix Video Quality at Scale with Cosmos Microservices
(netflixtechblog.com) -
Database Sharding vs. Partitioning: What’s the Difference?
(www.singlestore.com) -
The Journey of Building a Scalable API
(engineering.salesforce.com) -
CarbonJ: A high performance, high-scale, drop-in replacement for carbon-cache and carbon-relay
(engineering.salesforce.com)#software-architecture #scaling #distributed-systems #data-engineering
-
How we built a forever-free serverless SQL database
(www.cockroachlabs.com) -
Kangaroo: A new flash cache optimized for tiny objects
(engineering.fb.com) -
Presentation: BBC Online: Architecting for Scale with the Cloud and Serverless
(www.infoq.com) -
Processing billions of events in real time at Twitter
(blog.twitter.com)#software-architecture #scaling #distributed-systems #data-engineering
-
Article: Building Tech at Presidential Scale
(www.infoq.com)#software-engineering #software-architecture #scaling #backend
-
Automating Data Protection at Scale, Part 2
(medium.com) -
Building the Next Evolution of Cloud Networks at Slack – A Retrospective
(slack.engineering) -
Efficient Resource Management at Pinterest’s Batch Processing Platform
(medium.com) -
How to ETL at Petabyte-Scale with Trino
(engineering.salesforce.com) -
Evolution of Region Assignment in the Apache HBase Architecture — Part 3
(engineering.salesforce.com)#performance #scaling #distributed-systems #data-engineering
-
Building Uber’s Fulfillment Platform for Planet-Scale using Google Cloud Spanner
(eng.uber.com) -
Ensuring High Availability of Ads Realtime Streaming Services
(medium.com) -
Partitioning GitHub’s relational databases to handle scale
(github.blog) -
How Airbnb Enables Consistent Data Consumption at Scale
(medium.com)#data-pipeline #software-architecture #scaling #distributed-systems
-
Nrtsearch: Yelp’s Fast, Scalable and Cost Effective Search Engine
(engineeringblog.yelp.com)#software-architecture #search #scaling #distributed-systems
-
Scaling LinkedIn's Hadoop YARN cluster beyond 10,000 nodes
(engineering.linkedin.com) -
Sourcerer: Data Ingestion at Myntra
(medium.com) -
Scalable logging for microservices
(medium.com) -
IDEA 2.0 — A look at scalable Micro-Service Architecture
(medium.com) -
Building Scalable Streaming Pipelines for Near Real-Time Features
(eng.uber.com) -
RAMP-TAO: Layering atomic transactions on Facebook’s online graph store
(engineering.fb.com) -
How a High-Availability Database Empowers Mux to Scale Video
(www.cockroachlabs.com) -
How we scaled the size of Pinterest’s ad corpus by 60x
(medium.com) -
Failover Plans, Outage Playbooks and Resilience Gaps
(open.nytimes.com) -
Pinot Real-Time Ingestion with Cloud Segment Storage
(eng.uber.com) -
Building scalable near-real time indexing on HBase
(medium.com) -
Interactive Querying with Apache Spark SQL at Pinterest
(medium.com) -
Assess, Test and Prepare for the (Un)Expected News Event
(open.nytimes.com) -
Elastic Distributed Training with XGBoost on Ray
(eng.uber.com) -
Improving data processing efficiency using partial deserialization of Thrift
(medium.com) -
Scaling Worldwide Parcel Logistics with SingleStore and Vectorized
(www.singlestore.com) -
Grab App at Scale with Scylla
(www.scylladb.com) -
Navigating the 8 fallacies of distributed computing
(ably.com) -
Building Logging for a Distributed Database: Splunk vs ELK vs BYO
(www.cockroachlabs.com) -
Realtime and databases — a discussion on coupling versus modularity
(ably.com) -
Contextual Ads: Scylla at GumGum
(www.scylladb.com) -
Presentation: How to Tame Your Service APIs: Evolving Airbnb’s Architecture
(www.infoq.com) -
Modernizing Business Data Indexing
(engineeringblog.yelp.com) -
Scaling our inventory cache reads to 1000X
(medium.com) -
Scaling of Uber’s API gateway
(eng.uber.com) -
Block Aggregator: Real-time Data Ingestion from Kafka to ClickHouse with Deterministic Retries
(tech.ebayinc.com) -
Presentation: Rebuilding Twitter’s Public API
(www.infoq.com) -
How to Deploy a Multi-Region Application: Under the Hood
(www.cockroachlabs.com) -
Why Elasticsearch is an indispensable component of the Adyen stack
(www.elastic.co) -
The exabyte club: LinkedIn’s journey of scaling the Hadoop Distributed File System
(engineering.linkedin.com)#scaling #distributed-systems #analytics #big-data #data-engineering
-
Scaling Club Leaderboard Infrastructure for Millions of Users
(medium.com) -
Improving system performance with Redis
(capgemini.github.io) -
Building a Hyper Self-Service, Distributed Tracing and Feedback System for Rule & Machine Learning (ML) Predictions
(engineering.grab.com)#data-pipeline #infra #machine-learning #scaling #distributed-systems
-
Fraud Detection: Using Relational Graph Learning to Detect Collusion
(eng.uber.com) -
The Architecture of Uber’s API gateway
(eng.uber.com) -
Optimizing payments with machine learning
(dropbox.tech) -
Vinted Search Scaling Chapter 4: Query Log
(engineering.vinted.com) -
Receive Side Scaling (RSS) with eBPF and CPUMAP
(developers.redhat.com) -
Running Border Gateway Protocol in large-scale data centers
(engineering.fb.com) -
LyftLearn: ML Model Training Infrastructure built on Kubernetes
(eng.lyft.com) -
pprof++: A Go Profiler with Hardware Performance Monitoring
(eng.uber.com) -
Google Provides a Peek into the Architecture of Colossus - Its Storage Foundation
(www.infoq.com) -
Scaling Kubernetes with Assurance at Pinterest
(stackshare.io) -
Speeding Ahead with a Systematic Approach to Web Performance
(eng.lyft.com) -
Himeji: a scalable centralized system for authorization at Airbnb
(medium.com) -
Adopting RocksDB within Manhattan
(blog.twitter.com) -
Simple scalable graph neural networks
(blog.twitter.com) -
Solving for the cardinality of set intersection at scale with Pinot and Theta Sketches
(engineering.linkedin.com) -
Scaling Kubernetes with Assurance at Pinterest
(medium.com) -
How we scaled the GitHub API with a sharded, replicated rate limiter in Redis
(github.blog) -
Presentation: It’s Not Your Machine, It’s Your Code
(www.infoq.com) -
Alibaba Cloud Uses Dapr to Support Its Business Growth
(www.infoq.com) -
Scaling Rails to 125,000 Requests per Minute on Heroku
(zeemee.engineering) -
Beat - An Acoustics Inspired DDoS Attack
(blog.cloudflare.com) -
Scaling Cache Infrastructure at Pinterest
(stackshare.io) -
ReversingLabs: Serving File Reputation for Twenty Billion Files
(www.scylladb.com) -
Turbine: Facebook’s service management platform for stream processing
(engineering.fb.com) -
Presentation: Beyond the Distributed Monolith: Rearchitecting the Big Data Platform
(www.infoq.com) -
Presentation: Scalable, Cloud-native Data Applications by Example
(www.infoq.com) -
How Netflix brings safer and faster streaming experience to the living room on crowded networks…
(netflixtechblog.com) -
iFood Relies on Scylla to Deliver Over 100 Million Events a Month to Restaurants
(www.scylladb.com) -
How LINE messaging servers prepare for New Year’s traffic
(engineering.linecorp.com) -
18 Things You Can Do to Remove MySQL Bottlenecks Caused by High Traffic (Part One)
(www.percona.com) -
How we scaled Graphite to 100,000 writes per second.
(medium.com) -
Presentation: Streaming a Million likes/second: Real-time Interactions on Live Video
(www.infoq.com)#software-architecture #scaling #distributed-systems #data-engineering
-
Scaling Machine Learning
(towardsdatascience.com) -
Advanced schema management for Spark applications at scale
(engineering.linkedin.com) -
Challenges using Prometheus at scale
(sysdig.com) -
InSearch: LinkedIn’s new message search platform
(engineering.linkedin.com)#software-architecture #search #scaling #distributed-systems
-
Enabling HDFS Federation Having 1B File System Objects
(tech.ebayinc.com) -
Why We Leverage Multi-tenancy in Uber’s Microservice Architecture
(eng.uber.com) -
Kubernetes Autoscaling 101: Cluster Autoscaler, Horizontal Pod Autoscaler, and Vertical Pod…
(levelup.gitconnected.com) -
Using Kafka to Throttle QPS on MySQL Shards in Bulk Write APIs
(stackshare.io)#software-architecture #DBMS #scaling #apache-kafka #data-engineering
-
Presentation: "This Website is Not Secured" You Had One Job: Configuring the Edge Proxy!
(www.infoq.com) -
Presentation: High Resolution Performance Telemetry at Scale
(www.infoq.com) -
Tricks of the Trade: Tuning JVM Memory for Large-scale Services
(eng.uber.com) -
Handling 350k Requests for $3 using Lambda
(levelup.gitconnected.com) -
Understanding and implementing rate limiting in Node.js
(blog.logrocket.com) -
Running Online Services at Riot: Part VI
(technology.riotgames.com) -
99th Percentile Latency at Scale with Apache Kafka
(www.confluent.io) -
Prefetch Caching of eBay Items
(tech.ebayinc.com)#software-architecture #performance #scaling #backend #caching
-
Presentation: Building Confidence in Healthcare Systems Through Chaos Engineering
(www.infoq.com) -
Article: Anatomy of Cascading Failure
(www.infoq.com) -
K8s Vertical Pod Autoscaling
(itnext.io) -
Application Log Intelligence & Performance Insights at Salesforce using Flink
(engineering.salesforce.com) -
Podcast: Anurag Goel on Cloud Native Platforms, Developer Experience, and Scaling Kubernetes
(www.infoq.com) -
How Twitter Improves Resource Usage With a Deterministic Load Balancing Algorithm
(www.infoq.com) -
How We Built a Scalable Architecture for Real-Time Recommendations
(clevertap.com) -
Configuring SQL Server for High Availability in the Cloud
(hackernoon.com) -
Designing the Shortening URL system like Bit.ly, loading 6 billion clicks a month
(itnext.io)#software-engineering #software-architecture #scaling #backend
-
Fanatics: Using Scylla for Online Order Capture
(www.scylladb.com) -
How to Continuously Profile Tens of Thousands of Production Servers
(engineering.salesforce.com) -
Presentation: Fault Tolerance at Speed
(www.infoq.com)#software-architecture #performance #scaling #distributed-systems
-
Powering Pinterest ads analytics with Apache Druid
(medium.com) -
A Scientific Approach to Capacity Planning
(tech.wayfair.com) -
Presentation: The Reality of Managing Microservice Deployments at Scale: You Need a Spinnaker
(www.infoq.com) -
Presentation: Secrets at Planet-scale: Engineering the Internal Google KMS
(www.infoq.com) -
How to migrate a database schema at scale
(blog.logrocket.com) -
Preventing App Performance Degradation Due to Sudden Ride Demand Spikes
(engineering.grab.com) -
Design for failure - multiple layers of processing to protect against failures.
(allegro.tech)#software-engineering #software-architecture #scaling #backend
-
Plumbing At Scale
(engineering.grab.com)#data-pipeline #software-architecture #scaling #distributed-systems
-
Presentation: Practical Change Data Streaming Use Cases with Apache Kafka & Debezium
(www.infoq.com) -
Routing Engine — Central Work Dispenser
(medium.com)#software-architecture #scaling #distributed-systems #backend
-
Dynein – an Asynchronous Background Job Service from Airbnb
(www.infoq.com) -
Presentation: Beyond Microservices: Streams, State and Scalability
(www.infoq.com)#software-architecture #scaling #distributed-systems #microservices #backend
-
Creating a Zero-downtime cluster in NodeJS
(itnext.io) -
Experience Running Spotify’s Event Delivery System in the Cloud
(www.infoq.com) -
Presentation: Scaling Beyond a Billion Transactions Per Day with Sub-second Responses
(www.infoq.com)#software-architecture #infra #performance #scaling #data-engineering
-
Uber Infrastructure in 2019: Improving Reliability, Driving Customer Satisfaction
(eng.uber.com) -
Presentation: RabbitMQ and Kafka
(www.infoq.com) -
How ads indexing works at Pinterest
(medium.com)#data-pipeline #software-architecture #scaling #data-engineering
-
Presentation: Concurrency, Scalability and Transactions -- Myths and Surprises
(www.infoq.com)#software-architecture #scaling #distributed-systems #concurrency
-
Presentation: User & Device Identity for Microservices @ Netflix Scale
(www.infoq.com)#software-architecture #scaling #security #microservices #auth
-
Building performant large scale web applications
(blog.scottlogic.com) -
DBLog: A Generic Change-Data-Capture Framework
(medium.com) -
Uber’s Data Platform in 2019: Transforming Information to Intelligence
(eng.uber.com)#data-pipeline #scaling #distributed-systems #data-engineering
-
Presentation: Embracing Chaos!
(www.infoq.com) -
Presentation: Scaling Patterns for Netflix's Edge
(www.infoq.com) -
GokuL: Extending time series data storage to serve beyond one day
(medium.com) -
How Scylla Scaled to One Billion Rows a Second
(www.scylladb.com) -
Presentation: Building Reactive Pipelines: How to Go from Scalable Apps to (Ridiculously) Scalable Systems
(www.infoq.com) -
Struggling To Get A Handle On Traffic Surges
(www.smashingmagazine.com) -
Podcast: Josh Wills on Building Resilient Data Engineering and Machine Learning Products at Slack
(www.infoq.com)#software-architecture #machine-learning #scaling #data-engineering
-
Scalable and non-blocking event ingestion pipeline? Here’s how
(engineering.vinted.com) -
Kubernetes the Very Hard Way With Large Clusters at Datadog
(www.infoq.com)#software-architecture #scaling #distributed-systems #kubernetes #backend
-
Presentation: Future of Data Engineering
(www.infoq.com) -
Building a Kubernetes Platform at Pinterest
(stackshare.io) -
How Shopify Implements Custom Autoscaling Rules in Kubernetes
(www.infoq.com) -
Availability and Region Failure: Joint Consensus in CockroachDB
(www.cockroachlabs.com)#DBMS #scaling #distributed-systems #reliability #data-engineering
-
Egnyte Architecture: Lessons learned in building and scaling a multi petabyte content platform
(highscalability.com)#software-architecture #infra #scaling #distributed-systems #internet
-
7 Ways We Put Kubernetes to Work at Salesforce
(engineering.salesforce.com) -
The Two Most Important Challenges with an API Gateway when Adopting Kubernetes
(itnext.io) -
Sam Saffron AMA: Performance and Monitoring with Ruby
(engineering.shopify.com) -
Zendesk’s Global Mesh Network- Part 1
(medium.com) -
Semantics at Scale: BERT + Elasticsearch
(towardsdatascience.com) -
The Journey to Kubernetes High Availability - Part 4
(tech.findmypast.com) -
2019 @Scale Conference recap
(engineering.fb.com) -
Presentation: High Performance Cooperative Distributed Systems in Adtech
(www.infoq.com)#software-architecture #performance #scaling #distributed-systems
-
Open Sourcing Mantis: A Platform For Building Cost-Effective, Realtime, Operations-Focused…
(medium.com) -
Say Hello to Asynchronous Search for PySpark
(towardsdatascience.com) -
Load Balancers - Whats, Hows, and Whens
(hackernoon.com) -
🚂 On Track with Apache Kafka – Building a Streaming ETL Solution with Rail Data
(www.confluent.io) -
Presentation: Building and Operating a Serverless Data Pipeline
(www.infoq.com)#data-pipeline #software-architecture #scaling #cloud #serialization
-
Evolving Michelangelo Model Representation for Flexibility at Scale
(eng.uber.com) -
The Beauty of a Shared-Nothing SQL DBMS for Skewed Database Sizes
(www.memsql.com) -
Internet of Things (IoT) and Event Streaming at Scale with Apache Kafka and MQTT
(www.confluent.io) -
How LinkedIn customizes Apache Kafka for 7 trillion messages per day
(engineering.linkedin.com)#performance #scaling #distributed-systems #apache-kafka #data-engineering
-
Scribe: Transporting petabytes per hour via a distributed, buffered queueing system
(engineering.fb.com)#software-architecture #scaling #distributed-systems #networking
-
How Shopify Manages Petabyte Scale MySQL Backup and Restore
(engineering.shopify.com) -
Adaptive Throttling of Indexing for Improved Query Responsiveness
(medium.com) -
Productivity at scale: How we improved build time with Gradle build cache
(engineering.linkedin.com) -
Managing Global CDN Operations at Netflix
(www.infoq.com) -
Building Kubernetes Apps with Custom Scaling: A Gentle Introduction
(levelup.gitconnected.com) -
Scalability Tuning on a Tess.IO Cluster
(tech.ebayinc.com) -
Operating Apache Kafka Clusters 24/7 Without A Global Ops Team
(eng.lyft.com) -
Scaling a Mature Data Pipeline — Managing Overhead
(medium.com)#data-pipeline #software-architecture #scaling #distributed-systems
-
Presentation: Building and Running Applications at Scale in Zalando
(www.infoq.com)#software-engineering #software-architecture #scaling #practices
-
How Sqreen handles 50,000 requests every minute in a write-heavy environment
(stackshare.io) -
Joining Petabytes of Data Per Day: How LiveRamp Powers its Matching Product
(liveramp.com) -
Solving manageability challenges at scale with Nuage
(engineering.linkedin.com) -
Podcast: Event Sourcing: Bernd Rücker on Architecting for Scale
(www.infoq.com) -
Three Approaches to Scaling Machine Learning with Uber Seattle Engineering
(eng.uber.com)#software-engineering #machine-learning #scaling #production
-
Presentation: Building Resilient Serverless Systems
(www.infoq.com) -
Presentation: Metrics-driven Machine Learning Development at Salesforce Einstein
(www.infoq.com)#data-pipeline #software-engineering #machine-learning #scaling #production
-
Java debugging at scale: when rare events become commonplace
(blog.developer.atlassian.com) -
eBay's Hyperscale Platforms
(tech.ebayinc.com) -
Presentation: Conquering Microservices Complexity @Uber with Distributed Tracing
(www.infoq.com)#software-architecture #scaling #distributed-systems #microservices
-
Federated GraphQL Server at Scale: Zillow Rental Manager Real-time Chat Application
(www.zillow.com) -
Delivering ReactJS applications at scale
(medium.com) -
6 Lessons we learned when debugging a scaling problem on GitLab.com
(about.gitlab.com) -
How to manage your Snowflake spend with Periscope and dbt
(about.gitlab.com) -
Presto Infrastructure at Lyft
(eng.lyft.com)#infra #scaling #distributed-systems #backend #data-engineering
-
How we manage live 1M GraphQL Websocket Subscriptions
(hackernoon.com) -
How (Not) To Scale Deep Learning in 6 Easy Steps
(databricks.com) -
Who Depends On Me? Serving Dependency Queries at Scale
(engineering.linkedin.com) -
Data Engineering in Badoo: Handling 20 Billion Events per Day
(www.infoq.com)#data-pipeline #software-architecture #scaling #data-engineering
-
Building a Kubernetes platform at Pinterest
(medium.com) -
How we manage live 1M GraphQL Websocket Subscriptions
(itnext.io) -
How We Built A Logging Stack at Grab
(engineering.grab.com)#software-engineering #software-architecture #scaling #logging
-
A Scalable SQL Database Powers Real-Time Analytics at Uber
(www.memsql.com) -
Safely Rewriting Mixpanel’s Highest Throughput Service in Golang
(engineering.mixpanel.com)#software-engineering #software-design #scaling #GoLang #migration
-
Update: How CircleCI Processes Over 30 Million Builds Per Month
(stackshare.io) -
Presentation: Automatic Clustering at Snowflake
(www.infoq.com)#infra #DBMS #scaling #distributed-systems #data-engineering
-
Elasticsearch - clustering on AWS with optional auto-scaling
(blog.scottlogic.com) -
Random Forests for Store Forecasting at Walmart Scale
(medium.com) -
Presentation: No Moore Left to Give: Enterprise Computing After Moore's Law
(www.infoq.com) -
Open Sourcing Brooklin: Near Real-Time Data Streaming at Scale
(engineering.linkedin.com)#data-pipeline #software-architecture #scaling #distributed-systems #data-engineering
-
Presto at Pinterest
(medium.com) -
The Ultimate Guide To Building Scalable Web Scrapers With Scrapy
(www.smashingmagazine.com) -
Adaptive process and memory management for Python web servers
(instagram-engineering.com) -
Re-Architecting the Video Gatekeeper
(medium.com) -
Auto-Tuning Pinot Real-Time Consumption
(engineering.linkedin.com) -
Expediting Data Fixes and Data Migrations
(engineering.linkedin.com)#software-engineering #infra #scaling #practices #data-engineering
-
How Heroku Operates its Multi-Tenant Apache Kafka Services
(blog.heroku.com)#software-engineering #software-architecture #scaling #apache-kafka #backend
-
Recommendation Systems at Scale — Making Grab’s everyday app super
(towardsdatascience.com) -
Presentation: On a Deep Journey Towards Five Nines
(www.infoq.com) -
Catwalk: Serving Machine Learning Models at Scale
(engineering.grab.com)#data-pipeline #software-architecture #machine-learning #scaling #backend
-
Presentation: Verifying a Distributed System with Combinatorial Topology
(www.infoq.com)#software-architecture #scaling #distributed-systems #kubernetes
-
Search Party #18 — Crawling Edition
(blog.algolia.com) -
Presentation: Unique Resiliency of the BEAM and Erlang OTP
(www.infoq.com)#scaling #distributed-systems #runtime #availability #erlang
-
Presentation: Using Randomized Communication for Robust, Scalable Systems
(www.infoq.com) -
Autoscaling AWS Step Functions Activities
(engineeringblog.yelp.com) -
The Journey to Kubernetes High Availability - Part 2
(tech.findmypast.com) -
Presentation: The Evolution of Spotify Home Architecture
(www.infoq.com)#software-engineering #software-architecture #scaling #backend
-
Building a Scalable Search Architecture
(www.confluent.io) -
High Availability Kafka Service in Microsoft Azure Cloud
(medium.com) -
Presentation: What Lies Between: The Challenges of Operationalizing Microservices
(www.infoq.com)#software-engineering #scaling #microservices #practices #production
-
Bringing scalable real-time analytics to the enterprise
(www.oreilly.com)#DBMS #scaling #distributed-systems #podcast #data-engineering
-
Presentation: Scaling Erlang Cluster to 10,000 Nodes
(www.infoq.com)#software-architecture #performance #scaling #backend #erlang
-
Building Member Trust Through a Centralized and Scalable Settings Platform
(engineering.linkedin.com) -
The Journey to Kubernetes High Availability - Part 1
(tech.findmypast.com)#software-engineering #software-architecture #scaling #microservices #kubernetes
-
Presentation: Scaling for the Known Unknown
(www.infoq.com)#software-engineering #software-architecture #scaling #microservices #backend
-
Schemas, Contracts, and Compatibility
(www.confluent.io) -
Mobile Release Engineering at Scale with Shipit Mobile
(engineering.shopify.com) -
Using Rust to Scale Elixir for 11 Million Concurrent Users
(blog.discordapp.com) -
Securing Third-Party Applications at Scale
(engineering.salesforce.com) -
Partition Management in Hadoop
(blog.cloudera.com) -
Presentation: FreshEBT
(www.infoq.com) -
How Codacy Analyzes 30B Lines of Code Per Day
(stackshare.io) -
Presentation: YugaByte DB - A Planet-scale Database for Low Latency Transactional Apps
(www.infoq.com)#DBMS #performance #scaling #distributed-systems #data-engineering
-
Highly Available Postgres Databases
(tech.findmypast.com) -
Presentation: Airbnb’s Great Migration: Building Services at Scale
(www.infoq.com) -
Presentation: Continuous Profiling in Production: What, Why and How
(www.infoq.com)#software-engineering #devops #scaling #profiling #production
-
Presentation: Develop Hundreds of Kubernetes Services at Scale with Airbnb
(www.infoq.com) -
How Bloomberg Tracks Hundreds of Billions of Data Points Daily with MetricTank and Grafana
(grafana.com) -
Build a Monolith before Going for Microservices: Jan de Vries at MicroXchg Berlin
(www.infoq.com) -
End-to-end load testing Zalando’s production website
(jobs.zalando.com) -
Do the Math: Scaling Microservices Applications with Orchestrators
(www.toptal.com) -
Presentation: Complex Event Flows in Distributed Systems
(www.infoq.com) -
One Year of Load Balancing
(blog.algolia.com)#software-architecture #infra #scaling #networking #load-balancing
-
Pro Tips: How Booking.com Handles Millions of Metrics Per Second with Graphite
(grafana.com) -
Designing resilient systems beyond retries (Part 3): Architecture Patterns and Chaos Engineering
(engineering.grab.com) -
Designing resilient systems beyond retries (Part 2): Bulkheading, Load Balancing, and Fallbacks
(engineering.grab.com)#software-engineering #software-architecture #scaling #backend #systems
-
Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and…
(medium.com)#software-architecture #infra #scaling #backend #data-engineering
-
Presentation: Heavyweights: Tipping the Scales with Very Large Foundations
(www.infoq.com) -
How to Reindex One Billion Documents in One Hour at SoundCloud
(developers.soundcloud.com) -
Pro Tips: How Booking.com Handles Millions of Metrics Per Second with Graphite
(grafana.com) -
Solving Big Data Challenges with Data Science at Uber
(eng.uber.com)#DBMS #scaling #distributed-systems #big-data #data-engineering
-
Discord, on the Joy of Opinionated Systems
(www.scylladb.com) -
Authorization at LinkedIn’s Scale
(engineering.linkedin.com) -
How Twitch Addresses Scalability and Authentication
(blog.twitch.tv) -
How we moved a massively parallel Postgres database onto Kubernetes
(engineering.pivotal.io) -
Reinventing Facebook’s data center network
(code.fb.com) -
Stretching the Mold: How Alibaba Enhances Database Flexibility
(hackernoon.com) -
Feature Highlight: Scaling Autoplay Videos for Hundreds of Millions
(engineering.linkedin.com) -
How is software developed at Amazon?
(highscalability.com) -
Independently Scalable Multi-Container Microservices Architecture on AWS Fargate (I)
(hackernoon.com) -
Managing Uber’s Data Workflows at Scale
(eng.uber.com)#data-pipeline #DBMS #scaling #distributed-systems #big-data
-
How Netflix Uses AI and Machine Learning
(becominghuman.ai) -
Presentation: Achieving High Throughput with Reliability in Transactional Systems
(www.infoq.com) -
MySQL Challenge: 100k Connections
(www.percona.com) -
Prometheus Scalability with Bryan Boreham
(www.weave.works) -
Autoscaling Mesos Clusters with Clusterman
(engineeringblog.yelp.com) -
Presentation: Massively Scaling MySQL using Vitess
(www.infoq.com) -
Divide and conquer: Scale your Node.js app using distributed queues
(blog.logrocket.com) -
Consistent Hashing Simplified
(towardsdatascience.com) -
Highly Available MySQL Clustering at WePay Using Orchestrator, Consul and HAProxy
(www.infoq.com) -
Understanding Database Sharding
(www.digitalocean.com) -
Meshify and Scylla: an Industrial-Strength IoT Solution
(www.scylladb.com) -
Building a Scalable Event Pipeline with Heroku and Salesforce
(engineering.salesforce.com) -
Finding Kafka’s throughput limit in Dropbox infrastructure
(blogs.dropbox.com) -
Building Stable Systems with Load-Test Driven Development
(tech.just-eat.com) -
A Hybrid Cloud Approach from FraudGuard.io that Handles 50M Requests a Day
(highscalability.com) -
The scalable fabric behind our growing data center network
(blogs.dropbox.com) -
A Lean and Scalable Data Pipeline To Capture Large Scale Events and Support Experimentation Platform
(engineering.grab.com) -
Empowering Data Science with Engineering Education
(medium.com) -
MySQL High Availability Framework Explained – Part II
(highscalability.com) -
Presentation: Reasoning About Uncertainty at Scale
(www.infoq.com) -
Application Scaling with Raft
(rockthecode.io) -
An Incremental Architecture Approach to Building Systems
(www.infoq.com)#software-design #software-architecture #scaling #microservices
-
Introducing ThirdEye: LinkedIn’s Business-Wide Monitoring Platform
(engineering.linkedin.com)#software-design #software-architecture #scaling #distributed-systems #backend
-
Presentation: Building Responsive Systems with Serverless, Event-driven Java
(www.infoq.com)#software-architecture #scaling #java #backend #event-driven
-
Hey, you busy? I have thousands of questions to ask you.
(engineering.curalate.com) -
Scaling Machine Learning Productivity at LinkedIn
(engineering.linkedin.com)#data-science #software-engineering #machine-learning #scaling
-
Presentation: Crisis to Calm: Story of Data Validation @ Netflix
(www.infoq.com) -
PostgreSQL Connection Pooling and Load Balancing with PgPool-II Cluster
(hackernoon.com) -
Running Envoy as an Edge Proxy at eBay: Replacing Hardware Load Balancers with a Software Solution
(www.infoq.com) -
Querying Big Data in Real-Time with Presto & Grab's TalariaDB
(engineering.grab.com) -
Inside Stack Overflow’s Monitoring Systems
(www.infoq.com) -
5 ways Facebook improved compression at scale with Zstandard
(code.fb.com) -
Netflix OSS and Spring Boot — Coming Full Circle
(medium.com) -
Kubernetes in production @ ShopGun
(itnext.io)#software-engineering #software-architecture #scaling #kubernetes #production
-
Presentation: Scaling Slack - The Good, the Unexpected, and the Road Ahead
(www.infoq.com) -
Presentation: CRDTs in Production
(www.infoq.com)#software-architecture #DBMS #scaling #distributed-systems #systems
-
Bigtable Autoscaler: saving money and time using managed storage
(labs.spotify.com) -
Boosting Big Data workloads with Presto Auto Scaling
(www.eventbrite.com) -
Building Services at Airbnb Part 3
(medium.com) -
Our learnings from adopting GraphQL
(medium.com) -
Building a scalable, highly reliable, asynchronous user service
(tech.showmax.com) -
How to build a real-time leaderboard that’s serverless, fault-tolerant, and scaleable.
(engineering.gosquared.com) -
How Airbnb is Moving 10x Faster at Scale with GraphQL and Apollo
(medium.com) -
Engineering Uber’s Next-Gen Payments Platform
(eng.uber.com) -
Big on Heroku: Scaling Fountain without losing a drop
(evilmartians.com) -
Presentation: From Winning the Microservice War to Keeping the Peace
(www.infoq.com) -
Reasons to Scale Horizontally
(blog.wallaroolabs.com) -
Abstracting Sharding with Vitess and Distributed Deadlocks
(medium.com) -
Globalizing Player Accounts
(engineering.riotgames.com) -
Splitting Stateful Services across Continents at Instagram
(www.infoq.com) -
L4Drop: XDP DDoS Mitigations
(blog.cloudflare.com) -
How Pinterest runs Kafka at scale
(medium.com)#data-pipeline #software-architecture #scaling #apache-kafka #backend
-
Greenplum for Kubernetes Operator
(engineering.pivotal.io) -
Achieving Blockchain Scalability with Sparse Merkle Trees and Bloom Filters
(hackernoon.com) -
MySQL High Availability On-Premises: A Geographically Distributed Scenario
(www.percona.com) -
Progressive Service Architecture At Auth0
(auth0.com) -
Serving Millions of Users in Real-Time with Node.js & Microservices [Case Study]
(blog.risingstack.com) -
Article: Challenges of Building a Reliable Realtime Chat Service
(www.infoq.com)#software-architecture #scaling #real-time #messaging #event-driven
-
Cross shard transactions at 10 million requests per second
(blogs.dropbox.com)#software-design #software-architecture #scaling #distributed-systems #backend
-
Netflix MediaDatabase — Media Timeline Data Model
(medium.com) -
ELI5: Plasma Cash
(hackernoon.com) -
Sharding Cash
(medium.com) -
Scaling Time Series Data Storage — Part II
(medium.com) -
Rebuilding the Groups Experience on LinkedIn
(engineering.linkedin.com) -
Horizon: The first open source reinforcement learning platform for large-scale products and services
(code.fb.com) -
Scaling Machine Learning at Uber with Michelangelo
(eng.uber.com)#data-science #software-architecture #machine-learning #scaling
-
Reflecting on Building Real-time APIs at Facebook
(hackernoon.com) -
Presentation: Implementing AutoML Techniques at Salesforce Scale
(www.infoq.com) -
SQL at Scale with Apache Spark SQL and DataFrames — Concepts, Architecture and Examples
(towardsdatascience.com) -
Prisma Horizontal Scaling: a practical guide
(techblog.commercetools.com) -
Presentation: Digital Publishing for Scale: The Economist and Go
(www.infoq.com) -
iOS at Scale: Modularization of the Wayfair App
(tech.wayfair.com) -
The Netflix Media Database (NMDB)
(medium.com) -
Building Enterprise Software on LinkedIn's Consumer Stack: Behind the Scenes of LinkedIn Talent Hub
(engineering.linkedin.com) -
Dropbox traffic infrastructure: Edge network
(blogs.dropbox.com) -
A Brief History of High Availability
(www.cockroachlabs.com) -
Scaling PostgreSQL using Connection Poolers and Load Balancers for an Enterprise Grade environment
(www.percona.com) -
Architecture of Nautilus, the new Dropbox search engine
(blogs.dropbox.com)#software-architecture #search #scaling #big-data #filesystem
-
Our Adventures in Scaling
(eng.wealthfront.com) -
Building a dynamic and responsive Pinterest
(medium.com) -
Looking inside the technology that powers Pinterest
(medium.com) -
Presentation: How Blockchains Work and How to Scale Them
(www.infoq.com) -
Goku: Building a scalable and high performant time series database system
(medium.com) -
Presentation: No Microservice Is an Island
(www.infoq.com) -
How Discord Handles Two and Half Million Concurrent Voice Users using WebRTC
(blog.discordapp.com) -
Managing Software Dependency at Scale
(engineering.linkedin.com)#software-engineering #software-architecture #scaling #dependency-management
-
Iterating Towards a More Scalable Ingress
(shopifyengineering.myshopify.com) -
Presentation: Engineering Systems for Real-time Predictions @DoorDash
(www.infoq.com) -
Building Switch Software at Facebook Scale
(research.fb.com) -
PinSage: A New Graph Convolutional Neural Network for Web-Scale Recommender Systems
(medium.com) -
Presentation: Scaling Push Messaging for Millions of Devices @Netflix
(www.infoq.com) -
The Joys of Circuit Breaking
(medium.com)#software-architecture #scaling #distributed-systems #microservices
-
Auth0 Architecture: Running In Multiple Cloud Providers And Regions
(auth0.com) -
Scaling at Instacart: Distributing Data Across Multiple Postgres Databases with Rails
(tech.instacart.com) -
Nuage: Making Data Systems Management Scalable
(engineering.linkedin.com) -
Presentation: Serving Millions of Customers Serverless at CapitalOne
(www.infoq.com) -
New Dynamics for Topic Models
(blog.fastforwardlabs.com) -
Building a distributed rate limiter that scales horizontally
(blog.ably.io) -
Comparing Billions of Rows per Day
(segment.com) -
How SendGrid Scales Its Email Delivery Systems
(www.infoq.com) -
Hidden scaling issues of distributed systems — System design in the real world
(blog.ably.io) -
Presentation: Containers at Web Scale Panel
(www.infoq.com) -
Simple Steps to Optimize Your App Performance with MongoDB, Redis, and Node.js
(getstream.io) -
Productivity at Scale: How We Improved Build Time by 400% at LinkedIn
(engineering.linkedin.com) -
Presentation: Chick-Fil-A: Milking the Most Out of 1000's of K8s Clusters
(www.infoq.com) -
Goodbye Microservices: From 100s of problem children to 1 superstar
(segment.com)#software-engineering #software-architecture #scaling #microservices
-
Presentation: Applied Performance Theory
(www.infoq.com) -
Difference between SideChains and State Channels
(hackernoon.com) -
How SendGrid Scaled to 40 Billion Emails Per Month
(stackshare.io) -
Migrating Messenger storage to optimize performance
(code.facebook.com) -
Scaling Network Automation at Facebook Using Zero-Touch Provisioning
(www.infoq.com) -
Scaling Effectively: when Kubernetes met Celery
(hackernoon.com) -
MySQL High Availability at GitHub
(githubengineering.com) -
From startup to web scale: A gentle introduction to scaling
(hackernoon.com) -
How Ably Efficiently Implemented Consistent Hashing
(highscalability.com) -
Presentation: Models in Minutes not Months: AI as Microservices
(www.infoq.com) -
Keeping Node.js Fast: Tools, Techniques, And Tips For Making High-Performance Node.js Servers
(www.smashingmagazine.com) -
Building Scalable Web Services in Golang
(medium.com) -
Concourse: Generating Personalized Content Notifications in Near-Real-Time
(engineering.linkedin.com)#software-architecture #scaling #distributed-systems #backend
-
Centrifuge: a reliable system for delivering billions of events per day
(segment.com) -
Scaling the Facebook backbone through Zero Touch Provisioning
(code.facebook.com) -
How Raygun Processes Millions of Error Events Per Second
(stackshare.io) -
Making LinkedIn's Organic Feed Handle Peak Traffic
(engineering.linkedin.com) -
Scaling Collaborative Filtering with PySpark
(engineeringblog.yelp.com) -
High availability and scalable reads in PostgreSQL
(blog.timescale.com) -
Evolution of Couchbase at LinkedIn
(engineering.linkedin.com) -
Google: Addressing Cascading Failures
(highscalability.com) -
Testing our Confidence: Scaling Software Quality with Automated Testing
(tech.wayfair.com) -
Building Real Time Analytics APIs at Scale
(blog.algolia.com) -
@Scale – Part I (Task Queues)
(blog.imaginea.com) -
Scaling Uber’s Hadoop Distributed File System for Growth
(eng.uber.com) -
How ipdata serves 25M API calls from 10 infinitely scalable global endpoints for $150 a month
(highscalability.com) -
Fabric Aggregator: A flexible solution to our traffic demand
(code.facebook.com) -
Solution Deep Dive: Building a Highly Available Web Application with Web Processing and Storing Capabilities Using MongoDB and Elk Stack
(www.digitalocean.com) -
Scaling Infrastructure Management with Grail
(eng.uber.com) -
A Pods Architecture To Allow Shopify To Scale
(shopifyengineering.myshopify.com) -
How We Built Wallaroo to Process Millions of Messages/Sec with Microsecond Latencies
(blog.wallaroolabs.com) -
What I learnt from building 3 high traffic web applications on an embedded key value store.
(hackernoon.com) -
Running a scalable & reliable GraphQL endpoint with Serverless
(hackernoon.com) -
The Quest for Availability.
(hackernoon.com) -
How we built rearranging Pins
(medium.com) -
How production engineers support global events on Facebook
(code.facebook.com) -
HelloFresh: Navigating the rough seas of environment scaling with Aho
(highscalability.com) -
CSS best practices: scaling CSS in a fast-growing SaaS startup
(blog.sqreen.io) -
Improving Android video on News Feed with Litho
(code.facebook.com) -
Building scalable microservices with gRPC
(blog.bugsnag.com) -
Scaling Time Series Data Storage — Part I
(medium.com) -
Machine Learning for a Secure, Available, and Performant Infrastructure
(engineering.salesforce.com) -
How We Sped Up Eventually-Consistent Databases Global Syncs Through Caching
(www.pubnub.com) -
Apache Mesos, Apache Kafka and Kafka Streams for Highly Scalable Microservices
(www.confluent.io) -
Serverless, Scale-Independent Processing, and Wallaroo
(blog.wallaroolabs.com) -
What's a Load Balancer? Rabbit Holes and Wormholes
(fly.io) -
Scaling FTP at 000webhost.com
(www.hostinger.com) -
Agrarian-Scale Kubernetes: Part 3
(open.nytimes.com) -
Dubsmash: Scaling To 200 Million Users With 3 Engineers
(stackshare.io) -
Wrestling With Blockchain Scalability
(hackernoon.com) -
Agrarian-Scale Kubernetes: Part 2
(open.nytimes.com) -
Distributing Content to Open Connect
(medium.com)#software-engineering #software-architecture #scaling #backend
-
Netflix: What Happens When You Press Play?
(highscalability.com) -
How SoundCloud uses HAProxy with Kubernetes for user-facing traffic
(developers.soundcloud.com) -
Scaling PostgreSQL at Thumbtack: Load Balancing And Health Checks
(stackshare.io) -
CleverTap Engineering – Behavioral Messaging at 100B Scale
(clevertap.com) -
How to Improve IoT Application Performance with Multi-Row DML
(www.cockroachlabs.com) -
Scaling Slack’s Job Queue
(slack.engineering) -
Couchbase Ecosystem at LinkedIn
(engineering.linkedin.com)#software-architecture #scaling #distributed-systems #couchbase
-
How To Automate the Scaling of Your Web Application on DigitalOcean Ubuntu 16.04 Droplets
(www.digitalocean.com) -
How Etsy caches: hashing, Ketama, and cache smearing
(codeascraft.com) -
Improving Resiliency and Stability of a Large-scale Monolithic API Service
(engineering.linkedin.com)#software-design #software-architecture #scaling #availability
-
Scaling PostgreSQL: load balancing and healthchecks
(www.thumbtack.com) -
Snapfish’s Journey Towards Scylla
(www.scylladb.com) -
How To Create a High Availability Setup with Heartbeat and Floating IPs on Ubuntu 16.04
(www.digitalocean.com) -
Sending an e-mail to millions of users
(drivy.engineering) -
How we monitor Serverless apps with hundreds of functions
(hackernoon.com) -
Running Online Services at Riot: Part IV
(engineering.riotgames.com) -
Chaos Engineering at Twilio with Ratequeue HA
(twilioinc.wpengine.com) -
Expose DC/OS Apps to the Outside World with High-Performance Edge Load-Balancing
(mesosphere.com) -
How Discord Resizes 150 Million Images Every Day with Go and C++
(blog.discordapp.com) -
Reliability under abnormal conditions — Part One
(www.thoughtworks.com) -
How Sentry Receives 20 Billion Events Per Month While Preparing to Handle Twice That
(stackshare.io) -
Your options for partitioning in PostgreSQL 10, explained
(blog.timescale.com) -
Partition and conquer
(evilmartians.com) -
Architecting a Highly Scalable Golang API with Docker Swarm & Traefik
(hackernoon.com) -
Facebook SOSP papers present real-world solutions to complex system challenges
(research.fb.com) -
How Wallaroo Scales Distributed State
(blog.wallaroolabs.com) -
ButterCMS Architecture: a Mission-Critical API Serving Millions of Requests per Month
(highscalability.com) -
Scaling PhantomJS: Taking Thousands of Full Page Screenshots Every Day
(www.codementor.io) -
Ripple: The Most (Demonstrably) Scalable Blockchain
(highscalability.com) -
One Million Tables in MySQL 8.0
(www.percona.com) -
Serving One Billion JavaScript Library Downloads
(blog.algolia.com) -
Why SQL is beating NoSQL, and what this means for the future of data
(blog.timescale.com) -
The MySQL High Availability Landscape in 2017 (the Babies)
(www.percona.com) -
Autoscaling based on request queuing
(medium.com) -
An Introduction to Load Testing
(www.digitalocean.com) -
Massive Parallel Log Processing with ClickHouse
(www.percona.com) -
Optimizing web servers for high throughput and low latency
(blogs.dropbox.com) -
Elasticsearch: Adventures in scaling a multitenant platform
(www.bigeng.io) -
Introducing Social Hash Partitioner, a scalable distributed hypergraph partitioner
(research.fb.com) -
Kubernetes at GitHub
(githubengineering.com) -
How To Increase PageSpeed Score By Changing Your Nginx Configuration on Ubuntu 16.04
(www.digitalocean.com) -
Autoscaling applications @ PayPal
(www.paypal-engineering.com) -
Scaling Contextual Conversation Suggestions Over 500 Million Members
(engineering.linkedin.com) -
The BlackRock Messaging System
(rockthecode.io) -
Building an API Gateway using Node.js
(blog.risingstack.com) -
Engineering Scalable, Isolated Mobile Features with Plugins at Uber
(eng.uber.com)#software-engineering #software-architecture #scaling #mobile
-
Maximum Warp: Building Migrations for Slack Enterprise Grid
(slack.engineering)#software-engineering #software-architecture #scaling #api-backend
-
A Smarter, local-memory Django cache backend.
(devblog.kogan.com) -
How Uploadcare Built a Stack That Handles 350M File API Requests Per Day
(stackshare.io) -
Powering Helix’s Auto Rebalancer with Topology-Aware Partition Placement
(engineering.linkedin.com)#scaling #distributed-systems #cluster-management #fault-tolerance
-
7 Interesting Parallels Between the Invention of Tiny Satellites and Cloud Computing
(highscalability.com) -
Introducing Memsniff: A Robust Memcache Traffic Analyzer
(blog.box.com) -
Where Do I Put ProxySQL?
(www.percona.com) -
How Discord Scaled Elixir to 5,000,000 Concurrent Users
(blog.discordapp.com) -
Moving Yelp's Core Business Search to Elasticsearch
(engineeringblog.yelp.com)#software-architecture #scaling #distributed-systems #elastic
-
Engineering On-Demand Transportation for Business with Uber Central
(eng.uber.com) -
Delivering Billions of Messages Exactly Once
(segment.com) -
Open Sourcing Iris and Oncall
(engineering.linkedin.com) -
Yahoo Mail’s New Tech Stack, Built for Performance and Reliability
(yahooeng.tumblr.com) -
Harry Logger and the Metrics’ Stone
(blog.algolia.com)