Berger-Stefan/MultimodalNavigationIsaacSim
The repository acts as a playground to experiment with navigation using multimodal LLMs. The idea is that a robot has an MCP server that exposes tools like "getState" and "sendMovementCommand" such that LLM can get information about the environment and control the robot based on that.
Platform-specific configuration:
{
"mcpServers": {
"MultimodalNavigationIsaacSim": {
"command": "npx",
"args": [
"-y",
"MultimodalNavigationIsaacSim"
]
}
}
}Add the config above to .claude/settings.json under the mcpServers key.
Loading reviews...