Quickstart

Get up and running on the Portex Datalab.

This page gives a short overview of the two main workflows on Portex. For detailed guides, follow the links in each section.

For Experts

You create evals and sell (or open-source) them.

1. Create an account with seller access enabled

2. Design your eval: decide between Q&A (single-turn) and Agentic (multi-turn) and follow the best practices guide

3. Build your eval using the Eval Builder (or import files for Q&A evals if you prefer working in an editor)

4. Publish a listing commercially, or open-source it for community use

5. Review results as model builders submit runs and annotate responses to improve your eval

For Model Builders

You run models against expert evals and receive scored reports.

1. Create an account

2. Browse evals on the Datalab

3. Run an eval: download tasks, generate model responses, upload and pay

4. Optionally purchase the Core Dataset for model improvement