Best AI Infrastructure & MLOps Apps in 2026

Butter

AI Infrastructure & MLOps

Hi HN! I'm Erik. We built Butter, an LLM proxy that makes agent systems deterministic by caching and replaying responses, so automations behave consistently across runs. - It’s a chat completions compatible endpoint, making it easy to drop into existing agents with a custom base_url - The cache

No reviews yet

Replicate

AI Infrastructure & MLOps

Run and deploy AI models with a cloud API

No reviews yet

UltraContext

AI Infrastructure & MLOps

Hey HN! I'm Fabio and I built UltraContext, a simple context API for AI agents with automatic versioning. After two years building AI agents in production, I experienced firsthand how frustrating it is to manage context at scale. Storing messages, iterating system prompts, debugging behavior an

No reviews yet

Baseten

AI Infrastructure & MLOps

Serve and scale open-source and custom AI models on the fastest, most reliable inference platform.

No reviews yet

Hugging Face

AI Infrastructure & MLOps

The AI community platform for models and datasets

No reviews yet

LangSmith

AI Infrastructure & MLOps

LLM observability and testing platform

No reviews yet

Jido 2.0, Elixir Agent Framework

AI Infrastructure & MLOps

Hi HN! I'm the author of an Elixir Agent Framework called Jido. We reached our 2.0 release this week, shipping a production-hardened framework to build, manage and run Agents on the BEAM. Jido now supports a host of Agentic features, including: - Tool Calling and Agent Skills - Comprehensive mu

No reviews yet

Together AI

AI Infrastructure & MLOps

Build what's next on the AI Native Cloud. Full-stack AI platform for inference, fine-tuning, and GPU clusters — powered by cutting-edge research.

No reviews yet

Agenta

AI Infrastructure & MLOps

LLMOps platform for prompt management, LLM evaluation, and observability. Build, evaluate, and monitor production-grade LLM applications with collaborative prompt engineering. )

No reviews yet

LiteLLM

AI Infrastructure & MLOps

LLM Gateway (OpenAI Proxy) to manage authentication, loadbalancing, and spend tracking across 100+ LLMs. All in the OpenAI format.

No reviews yet

Dify

AI Infrastructure & MLOps

Open-source LLM application development platform

No reviews yet

Langchain

AI Infrastructure & MLOps

Framework for building LLM-powered applications

No reviews yet

Helicone

AI Infrastructure & MLOps

Routing and monitoring for reliable AI apps - the LLMOps platform behind the fastest-growing AI companies.

No reviews yet

Netron

AI Infrastructure & MLOps

Visualizer for neural network and machine learning models. )

No reviews yet

E2B

AI Infrastructure & MLOps

E2B Gives AI Agents Secure Computers with Real-World Tools. E2B is Used by 88% of Fortune 100 Companies for Frontier Agentic Workflows.

No reviews yet

Viseron

AI Infrastructure & MLOps

Self-hosted, local-only NVR and AI Computer Vision software. With features such as object detection, motion detection, face recognition and more, it gives you the power to keep an eye on your home, office or any other place you want to monitor. )

No reviews yet

Gram Functions

AI Infrastructure & MLOps

Hi HN, Georges from the Gram team here. We're really excited to share a major update to Gram, our platform for curating tools for agents, in the form of Gram Functions. Gram initially started out by letting users upload OpenAPI documents and turning them into tools that can be curated into smal

No reviews yet

Pi Labs

AI Infrastructure & MLOps

Hey HN, after years building some of the core AI and NLU systems in Google Search, we decided to leave and build outside. Our goal was to put the advanced ML and DS techniques we’ve been using in the hands of all software engineers, so that everyone can build AI and Search apps at the same level of

No reviews yet

BentoML

AI Infrastructure & MLOps

Inference Platform built for speed and control. Deploy any model anywhere, with tailored inference optimization, efficient scaling, and streamlined operations.

No reviews yet

CrewAI

AI Infrastructure & MLOps

Framework for orchestrating AI agents

No reviews yet

Erdos

AI Infrastructure & MLOps

Hey HN! We’re Jorge and Will from Lotas ( https://www.lotas.ai/ ), and we’ve built Erdos, a secure AI-powered data science IDE that’s fully open source ( https://www.lotas.ai/erdos ). A few months ago, we shared Rao, an AI coding assistant for RStudio ( https:/&#x2

No reviews yet

Flowise

AI Infrastructure & MLOps

Open source generative AI development platform for building AI agents, LLM orchestration, and more

No reviews yet

Langfuse

AI Infrastructure & MLOps

Open-source LLM observability and analytics

No reviews yet

LocalAI

AI Infrastructure & MLOps

Run your AI models locally and generate images and audio (alternative to OpenAI and Claude). , [Clients](https://localai.io/gallery.html))

No reviews yet

Modal

AI Infrastructure & MLOps

Serverless cloud for AI and data workloads

No reviews yet

Ollama

AI Infrastructure & MLOps

Ollama is the easiest way to automate your work using open models, while keeping your data safe.

No reviews yet

Phidata

AI Infrastructure & MLOps

Agno pairs the fastest framework available with the first enterprise-ready agentic operating system, AgentOS. Build, run, and manage secure multi-agent systems inside your cloud.

No reviews yet