Close Menu
    What's Hot

    Imagen 4 or Imagen 4 Ultra Now Available in Gemini API

    July 3

    MiniMax-M1 Now #1 Open Source Model in Math

    July 2

    How to Generate Animal Olympics Videos with AI

    July 1
    Facebook X (Twitter) Instagram
    • AI Robots
    • AI News
    • Text to Video AI Tools
    • ChatGPT
    Facebook X (Twitter) Instagram Pinterest Vimeo
    Rad NeuronsRad Neurons
    • AI Robots
      • AI Coding
    • ChatGPT
    • Text to Video AI
    Subscribe
    Rad NeuronsRad Neurons
    Home » Quadruped Robot Learning Skills from Single Video Demonstration with ChatGPT-4o
    AI Robots

    Quadruped Robot Learning Skills from Single Video Demonstration with ChatGPT-4o

    AI NinjaBy AI NinjaOctober 162 Mins Read
    Share Facebook Twitter Pinterest LinkedIn Tumblr Reddit Telegram Email
    Share
    Facebook Twitter LinkedIn Pinterest Email

    There are many ways to teach robots new skills. With LLMs, it will now be easier to help robots learn how to perform complex tasks. SDS (See It, Do It, Sorted) is a new quadrupedal skill learning approach using a single video. Here is how it works:

    Leveraging the Visual capabilities of GPT-4o, SDS processes input videos through our novel chain-of-thought promoting technique (SUS) and generates executable reward functions (RFs) that drive the imitation of locomotion skills, through learning a Proximal Policy Optimization (PPO)-based Reinforcement Learning (RL) policy, using environment information from the NVIDIA IsaacGym simulator. SDS autonomously evaluates the RFs by monitoring the individual reward components and supplying training footage and fitness metrics back into GPT-4o, which is then prompted to evolve the RFs to achieve higher task fitness at each iteration.

    This system enables quadruped robots to learn skills by watching a single video. It uses GPT-4o to  analyze the video and create reward functions, which guide the robot in imitating movements like walking, hopping, or running. A Unitree Go1 robot was used to test this. What’s neat is you don’t need large datasets to train robots with this system.

    SDS - See it, Do it, Sorted: Quadruped Skill Synthesis from Single Video Demonstration

    [HT] [Authors: Jeffrey Li, Maria Stamatopoulou, and Dimitrios Kanoulas]

    GPT quadruped
    Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
    Previous ArticleApple Announces iPad mini Made for Apple Intelligence with ChatGPT
    Next Article Tad AI: New AI Music Generator, Suno Killer?
    AI Ninja
    • Website

    Related Posts

    AI Robots

    SenseCAP Watcher Physical AI Agent

    June 27
    ChatGPT

    HAIXINDA ChatGPT Translation Glasses

    June 16
    ChatGPT

    Merryking AI GPT-4o Smartwatch for Translation & Fitness

    June 13
    Add A Comment
    Leave A Reply Cancel Reply

    Top Posts

    Higgsfield AI Generates Stunning Cinematic Video

    April 19 Views

    DR01 Autonomous Learning Humanoid Robot

    October 291 Views

    Replit Agent Now Available on Mobile Devices

    February 513 Views
    More
    AI News

    MiniMax-M1 Now #1 Open Source Model in Math

    AI NinjaJuly 2
    AI News

    Hunyuan-A13B Open Source LLM Debuts, Competes with o1, DeepSeek

    AI NinjaJune 27
    AI News

    Prompt Cannon: Run Prompts Across Multiple Models

    AI NinjaJune 24
    Most Popular

    Prompt Cannon: Run Prompts Across Multiple Models

    June 24758 Views

    GPTARS: GPT Powered TARS Robot

    November 21529 Views

    Simple Grok 2 Jailbreak

    December 16454 Views
    Our Picks

    Imagen 4 or Imagen 4 Ultra Now Available in Gemini API

    July 3

    MiniMax-M1 Now #1 Open Source Model in Math

    July 2

    How to Generate Animal Olympics Videos with AI

    July 1
    Tags
    3D agent AI AI glasses AI model ai video app Blender canvas ChatGPT Chess Claude coding coding agent Deep Research DeepSeek ElevenLabs Gemini glasses GPT GPT 4.5 image kling leonardo LLM Manus MCP midjourney Mini PC model music o3 open source pdf QWEN robot runway sora Suno text to video Veo 2 Vibe coding video video model Voice

    © 2025 Rad Neurons. Inspired by Entropy Grid
    • Home
    • Terms of Use
    • Privacy Policy
    • Disclaimer

    Type above and press Enter to search. Press Esc to cancel.