distil labs is a developer tool that gives everyone the super powers of a Machine Learning Scientist.

Everyone loves using an LLM in the cloud, but it is not applicable for every use case. Where privacy is a priority, on-device inference is a necessity or costs are a serious consideration – you need to use smaller models.

The challenge is that out-of-the-box small model performance is not good enough to be used in production, so you need to specialize them. This is not an easy task – you need thousands of data points and specialist skills.

We know exactly how challenging it is to build custom models and that is why we built distil labs – a tool that allows anyone to create their own small custom agents with just a prompt.