Mistral AI · Schema

ForgeHyperparameters

Properties

Name Type Description
learning_rate number The learning rate for training.
training_steps integer The number of training steps.
batch_size integer The batch size for training.
weight_decay number Weight decay applied during training.
warmup_steps integer Number of warmup steps.
View JSON Schema on GitHub

JSON Schema

mistral-forgehyperparameters-schema.json Raw ↑ 
{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "$id": "#/components/schemas/ForgeHyperparameters",
  "title": "ForgeHyperparameters",
  "type": "object",
  "properties": {
    "learning_rate": {
      "type": "number",
      "description": "The learning rate for training.",
      "minimum": 0.0
    },
    "training_steps": {
      "type": "integer",
      "description": "The number of training steps.",
      "minimum": 1
    },
    "batch_size": {
      "type": "integer",
      "description": "The batch size for training.",
      "minimum": 1
    },
    "weight_decay": {
      "type": "number",
      "description": "Weight decay applied during training.",
      "minimum": 0.0
    },
    "warmup_steps": {
      "type": "integer",
      "description": "Number of warmup steps.",
      "minimum": 0
    }
  }
}