Quickstart

Get up and running on the Portex Datalab.

This page gives a short overview of the two main workflows on Portex. For detailed guides, follow the links in each section.

For Experts

You create evals and sell them to model builders.

1. Create an account with seller access enabled

2. Design your eval using the best practices guide

3. Build your eval using the Eval Builder (or import files if you prefer working in an editor/json files)

4. Publish a listing with pricing and license terms

5. Review results for leaderboard runs and annotate responses to improve evals

For Model Builders

You run models against expert evals and receive scored reports.

1. Create an account

2. Browse evals on the Datalab

3. Run an eval: download tasks, generate model responses, upload and pay

4. Optionally purchase the Core Dataset for model improvement