Microservice frameworks & service infrastructure: top picks for 2026

A free, open-source study guide for learning large-scale system design and preparing for system design interviews, with sample solutions and Anki flashcards.

A Chinese-language Java backend interview guide covering CS fundamentals, databases, distributed systems, system design and AI application development.

Open source system for deploying, scaling and managing containerized applications across multiple hosts.

A high-performance HTTP web framework for Go with a Martini-like API, built for REST APIs, web apps and microservices.

An opinionated Java framework for building production-grade, Spring-powered applications and services with minimal setup.

Distributed, RESTful search and analytics engine that also serves as a scalable data store and vector database.

An in-memory data store used as a cache, data structure server, document store, vector database, and message broker.

A progressive Node.js framework for building efficient, scalable server-side applications in TypeScript or JavaScript.

A cloud native HTTP reverse proxy and load balancer that auto-configures routes from Docker, Kubernetes, Consul and other orchestrators.

Distributed, reliable key-value store for the most critical data of a distributed system, built on Raft consensus with a gRPC API.

Open-source column-oriented database management system for generating analytical data reports in real time.

A self-hosted AI gateway that exposes OpenAI, Claude and Gemini compatible APIs in front of many upstream model providers, with routing, keys, quotas and cost tracking.

Milvus is an open-source, distributed vector database for storing and searching embeddings at scale, used for AI search and RAG applications.

Kong is a cloud-native, platform-agnostic API, LLM and MCP gateway, extensible through plugins, for routing and securing service traffic.

Java implementation of Apache Dubbo, an RPC and microservice framework for building service communication, discovery and traffic management.

End-to-end typesafe APIs for TypeScript with no schemas or code generation, sharing types between server and client.

Open-source distributed SQL database with MySQL 8.0 compatibility, ACID transactions, HTAP analytics, and vector search.

Open-source cross-platform API client for GraphQL, REST, WebSockets, SSE and gRPC, with local, Git and cloud storage.

A self-hosted OpenAI-compatible gateway that pools free LLM provider tiers behind one /v1 endpoint, with routing and failover.

Open source cross-platform file explorer built on a virtual distributed filesystem written in Rust, with no hosted account required.

An open source service mesh that adds traffic management, security and observability to microservices with few or no code changes.

Open-source platform for dynamic service discovery, dynamic configuration management, and service metadata management in cloud native and microservice systems.

A Go web and RPC microservices framework with built-in resilience features and a goctl code generator driven by .api specs.

A cloud-native distributed SQL database built on a strongly-consistent key-value store, with PostgreSQL wire protocol compatibility.

Open-source durable execution engine for orchestrating microservices, AI agents and adaptive workflow graphs, with workers in multiple languages.

A high-performance web server, reverse proxy, load balancer, API gateway and content cache written in C.

Helm is the package manager for Kubernetes, installing and managing apps packaged as reusable Charts.

Distributed service networking tool for service discovery, health checking, configuration, and service mesh across dynamic infrastructure.

Open source cloud native container registry that stores, signs, and scans images and Helm charts, with RBAC and replication.

Distributed task queue for Python that runs background jobs and schedules work across workers and message brokers.