Skip to content

Mabyduck API (0.7.5)

API for managing subjective studies on Mabyduck.

Download OpenAPI description
Languages
Servers
https://api.mabyduck.com

Datasets

Operations related to datasets.

Operations

Experiments

Operations related to experiments.

Operations

Rubrics

Operations related to rubrics and leaderboards.

Operations
Operations

Request

Returns a list of metrics corresponding to various sources.

Security
ApiKeyAuth
Path
project_idstring^[a-zA-Z0-9]+$required
Query
metricstring

Filter by this type of metric.

Enum"bayesian_elo""elo""mean""stats""win_loss"
sourcestring

A comma-separated list of job, experiment, or leaderboard IDs.

curl -i -X GET \
  'https://api.mabyduck.com/projects/{project_id}/metrics/?metric=bayesian_elo&source=string' \
  -H 'Authorization: Api-Key <YOUR_TOKEN_HERE>'

Responses

Bodyapplication/jsonArray [
kindstring(KindEnum)required
  • bayesian_elo - Elo
  • elo - Elo (vanilla)
  • mean - MOS
  • win_loss - Win/loss
  • stats - Statistics
Enum"bayesian_elo""elo""mean""win_loss""stats"
dimensionstring or null<= 32 characters

Used by experiments evaluating multiple criteria simultaneously.

sourcestring or nullread-onlyrequired

Return the source of the metric (job or experiment).

scoresArray of objectsread-onlyrequired

Return the scores for each method.

]
Response
application/json
[ { "kind": "bayesian_elo", "dimension": "string", "source": "string", "scores": [] } ]