Member-only story

Recently, Andrew Ng Released aisuite — But How Does It Stack Up Against Litellm?

Mohd Saqib
4 min readDec 1, 2024

Source

In the fast-paced world of AI, there’s no shortage of tools claiming to revolutionize how we interact with large language models (LLMs). Recently, Andrew Ng, one of the most prominent figures in AI, announced the release of aisuite, an open-source Python package designed to simplify integration with multiple LLM providers. The premise? Switch between providers like OpenAI, Anthropic, or Ollama with just a single line of code. Sounds revolutionary, right?

But here’s the twist: a similar tool called Litellm has been quietly solving the same problem with a simpler and more concise syntax. So now the burning question is: How do these two libraries compare in real-world scenarios?

In this article, we’ll dig into the strengths and weaknesses of both libraries. By the end, you’ll know which one is best suited for your use case — and we’ll even show you a real-world chatbot implementation using both tools to let you decide for yourself.

The Big Idea Behind aisuite

Andrew Ng’s aisuite is all about flexibility and control. With support for multiple LLM providers, the library allows developers to specify models using strings like openai:gpt-4o or anthropic:claude-3-5-sonnet-20241022. It’s designed to cater to advanced use…

The author made this story available to Medium members only.
If you’re new to Medium, create a new account to read this story on us.

Or, continue in mobile web

Already have an account? Sign in

Mohd Saqib
Mohd Saqib

Written by Mohd Saqib

Scholar @ McGill University, Canada | IIT (ISM) | AMU | Travel | msaqib.cs@gmail.com

Responses (1)

Write a response

Ahem. Feature set wise, LiteLLM brings more on board than just a "toggle" for going from one model to another. So, comparing LiteLLM to plain vanilla PY would not be the right comparison.