Woro AI/Blog/AWS Machine Learning

AWS Machine Learning

Exa boosts embedding throughput by 50% to index billions of documents on AWS AI chips

· 1 min read · Summary from AWS Machine Learning

Exa's neural search engine is backed by an in-house vector database, so the unit economics of embedding tens of billions of web documents drive the business. This post shares how Exa optimized embedding inference on AWS Neuron hardware (Inferentia2 and Trainium2) with custom NKI kernels, reaching a 47% gain in performance and cost per million documents.

Read the full story at AWS Machine Learning →
Woro AI

Read about it here. Run it from WhatsApp.

Start free