Baseten

AI inference infrastructure

Baseten develops infrastructure for serving and scaling AI models in production. Its engineering work includes model deployment, orchestration, monitoring and low-level performance optimization.

Technical focus

The company’s about page describes work on training and tuning models, identifying performance bottlenecks and balancing latency, throughput and reliability. Areas include kernels, quantization, batching, routing and hardware selection for real customer workloads.