Publishing Your Eval

Create a listing and publish your eval on the Datalab.

Once your eval dataset is created, you can publish it as a listing on the Datalab. This makes it discoverable by model builders who can purchase runs against your eval.

Set Pricing

From the Data Studio, go to Evals > Manage > Edit Listings. Select your eval dataset and you can manage the listing within the listing editor.

Pricing fields

• Price Per Eval: the price a model builder pays each time they submit responses and receive a graded report

• Core Dataset Price (Buy Now): a fixed price for the full Core Dataset bundle (tasks, answers, criteria, reference files)

• Core Dataset Minimum Bid: the floor for sealed bids on the Core Dataset

The Core Dataset fields only appear if your eval includes a Core Dataset.

Configure Listing Details

On the next screen, fill in:

• Title

• Short description (max 300 characters)

• Long description (markdown editor with image upload support)

• Modality, Domain, and Use Case tags

• At least one of:

  • Stripe account (for Stripe payouts)

  • Recipient address (EVM wallet for USDC payouts if applicable)

• Preview image (upload or auto-generate)

Note: if you select payouts in USDC, make sure that your wallet supports payments on the Base Network. See more from Coinbase here.

O*NET-SOC Occupation

You can optionally tag your eval with an occupation from the O*NET-SOC taxonomy. This helps model builders filter evals by job family and enables occupational benchmarking. If you leave it unselected, Portex will assign one.

Configure License

Click "Configure License" to choose a PSDLA variant and set terms. See PSDLA for details on each license type. Default for evals is PSDLA-EVAL.

You can set the license duration (1-10 years) and add custom clauses for field-limited use or other restrictions.

Publish or Save as Draft

At the bottom of the listing editor, toggle between Draft and Live status. Saving as a draft lets you preview the listing without making it public. When ready, set it to Live and click "Create Listing" (or "Update Listing" for edits).

Your eval is now live on the Datalab. Model builders can find it on the Explore page, download tasks, and submit runs.

You can share your eval and view it live on the Datalab. Once our leaderboard runs are finished, you can see model performance within the Leaderboards tab.

Managing Your Listing

From the Data Studio under Listings > Edit Listings, you can:

• Edit pricing, descriptions, tags, and license terms

• Toggle between Draft and Live

• Delete a listing (requires password confirmation, irreversible)