Woro AI/Blog/AWS Machine Learning
AWS Machine LearningExa boosts embedding throughput by 50% to index billions of documents on AWS AI chips
· 1 min read · Summary from AWS Machine Learning
Exa's neural search engine is backed by an in-house vector database, so the unit economics of embedding tens of billions of web documents drive the business. This post shares how Exa optimized embedding inference on AWS Neuron hardware (Inferentia2 and Trainium2) with custom NKI kernels, reaching a 47% gain in performance and cost per million documents.
Read the full story at AWS Machine Learning →