Muse MuseConcept
Muse MuseConcept

Independent concept built on Meta's Model API. Not an official Meta product.

Gadgets

A gadget is a physical board a product can use to see and hear the real world.

What a gadget is

A small computer with a camera and a microphone, such as a Jetson board running muse-device. When a muse asks for hardware, the brief can add the gadget option next to the model that reads what the board captures, and the product reaches the board through Muse Muse's gateway.

What a product can ask a board to do

  1. describe_device

    Says which board it is and which cameras and microphones it has.

  2. capture_image

    Takes a photo with the board's camera.

  3. record_audio

    Records up to 30 seconds of sound with the board's microphone.

  • Every build gets a simulated board: the same receipt photo and three seconds of speech each time, so tests are steady and builds never reach real hardware.
  • Products can't run commands on a board. Only the three tools above are served.
  • A product must still work with no board, with a clear message and a way to upload instead.

Boards on hand

  • Jetson Orin Nano 8 GB

    • 6 on hand
    • Board server

    Runs muse-device, which gives a product the board's camera and microphone. It can also fine-tune a small model on its own GPU.

  • Raspberry Pi 5

    • 2 on hand
    • Planned gadget

    Meta lists the Pi 5 as a supported Muse gadget. One is planned as a real gadget on Meta's Linux Device SDK, paired to Muse Muse's own Muse account. Muse Muse never holds anyone else's gadget token.

  • Coral board

    • 2 on hand
    • On-device vision

    A Synaptics Coralboard SL that runs vision on its own NPU, to compare its detectors with SAM 3.1 on the same pictures. It reaches the network only while plugged into a Mac.

Status

Gadgets for new buildsThe brief can add the gadget option when a muse asks for hardware.
On
Live boardLive products with the option can't reach a board, so they say no gadget is connected.
Not set up

Products that use a gadget

No products use a gadget yet

Products built with the gadget option show up here once they ship.

Planned: connect your own board

Today, live products with the option can only use a board Muse Muse sets up. Connecting your own board is planned.