AI Habitat · Schema

AgentObservation

Full observation dict returned to an agent after each step

Artificial IntelligenceSimulationEmbodied AIRoboticsComputer-VisionReinforcement LearningMachine-LearningOpen-SourceResearch

Properties

Name	Type	Description
rgb	object	RGB camera observation
depth	object	Depth camera observation
pointgoal_with_gps_compass	object	Point goal with GPS/compass sensor
objectgoal	string	Object category name for ObjectNav tasks

View JSON Schema on GitHub

JSON Schema

{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "$id": "https://raw.githubusercontent.com/api-evangelist/ai-habitat/refs/heads/main/json-schema/ai-habitat-agent-observation-schema.json",
  "title": "AgentObservation",
  "description": "Full observation dict returned to an agent after each step",
  "type": "object",
  "properties": {
    "rgb": {
      "type": "object",
      "description": "RGB camera observation"
    },
    "depth": {
      "type": "object",
      "description": "Depth camera observation"
    },
    "pointgoal_with_gps_compass": {
      "type": "object",
      "description": "Point goal with GPS/compass sensor"
    },
    "objectgoal": {
      "type": "string",
      "description": "Object category name for ObjectNav tasks",
      "example": "chair"
    }
  }
}