Small Language Models

Small Language Models (SLMs) models in the context of Generative AI are general purpose deep-learning technologies that can be developed for various application, including chat function, image generation, voice recognition, code generation and many more.

In other words, they are foundational models for building fine-tuned applications. They differ from the mainstream Large Language Models (LLMs) in that SLMs usually have several billion or dozens of billion parameters, whereas LLMs may contain hundreds of billions of parameters, if not trillions.