Mouth expression, to MIDI

Your face is the expression pedal.

Face MIDI turns how far you open your mouth into a MIDI CC value, live, from your webcam. Sweep a wah, a filter or a volume knob hands-free while you play.

Download for macOS (.dmg) Windows (.exe) — coming soon
macOS 12 or later · Apple Silicon · free · everything runs on your Mac
V1.0.0 Face MIDI setup screen: a wireframe of the tracked face, the mouth aperture bar graph, the sent CC meter, six knobs and the calibration panel
See it in 90 seconds

A wah, a mouth, no hands.

Route the port, calibrate in two steps, play. The video runs the whole thing once.

Play · YouTube
ROUTEThe virtual port "Face MIDI Out" shows up in the plugin.
CALIBRATEMouth closed, mouth open. Three seconds each.
PLAYMIDI Learn the knob once. It follows the mouth from then on.
How it works

Three panels, in order.

1

Route it.

Face MIDI opens a virtual MIDI port called "Face MIDI Out". It appears in your DAW or plugin automatically while the app is open. Prefer a hardware or IAC port? Pick it from the list.

2

Calibrate in six seconds.

Two steps, each a three-second countdown: mouth closed, then mouth open. That is your range, and the app remembers it between launches.

The calibration panel with its STEP 1 key, RESET key and the SECONDS display
3

Play.

Right-click a knob in your plugin, choose MIDI Learn, press Send Test Signal in Face MIDI. From now on the knob follows your mouth.

Features

Built like a pedal, behaves like one.

Hands-free expression.

Both hands stay on the instrument. The CC value follows your mouth at camera rate, 30 frames a second.

Works with any plugin that has MIDI Learn.

Amp sims, wahs, filters, synth macros, DAW automation lanes. Standard MIDI CC, nothing proprietary.

A wireframe, not a webcam feed.

The camera window shows a live 3D wireframe of your face that turns and opens with you. The video preview is off by default and stays off unless you switch it on.

The camera window showing a frontal face wireframe The same wireframe with the head turned and the mouth open

Calibration that fits your face.

Closed and open are measured on you, not assumed. Reset and redo it any time.

Shape the response.

CC number and channel, min and max, invert, smoothing and a dead zone, saved per profile so each plugin gets its own.

Fail-safe by design.

Emergency Stop parks the value instantly, and the CC returns to a safe value whenever tracking stops or the app closes.

Face MIDI live screen: the big wireframe window, the sent CC needle meter and the mouth aperture bar graph
Privacy

Nothing leaves your Mac.

The camera is the most personal sensor on the machine. Face MIDI treats it that way.

macOS 12 or laterApple Silicon (arm64)a webcam, the built-in one is fineany DAW or plugin that accepts MIDI CCdownload about 270 MB
Status
  • All face tracking runs on your computer, in the app's own memory.
  • No frame is written to disk. No frame is sent anywhere.
  • The app makes no network requests: no telemetry, no analytics, no update checks, no account.
  • The face model ships inside the app; nothing is downloaded at runtime.
  • Camera preview is off by default. With it off, only landmark positions reach the interface, never pixels.
FAQ

Short answers.

Does it work with my plugin?

If the plugin has MIDI Learn or can map a MIDI CC to a parameter, yes. Face MIDI sends standard CC messages on the channel you choose.

How fast does it react?

The camera runs at 30 frames a second and the value is sent every frame. Smoothing is adjustable: lower for snappy wah, higher for slow swells.

Does it need an internet connection?

No. Nothing is downloaded and nothing is uploaded, ever.

Can I use it on stage?

Yes, as long as your face stays in the camera's view and reasonably lit. If the face is lost, the CC returns to the safe value you set.

Is there a Windows version?

Not yet.

Download

Free. On your Mac.

Download for macOS (.dmg) Windows (.exe) — coming soon
FaceMIDI-macOS-arm64.dmg · version 1.0.0 · release notes SHA-256 0f44a7c9403eb039dd21ea11d87671c82f6d69fb1f5b64a3514b2275dc2edcb3
First launch on macOS: the app is not yet notarized, so macOS may say it can't be checked for malicious software. Open System Settings → Privacy & Security and choose Open Anyway; you only do this once. Then allow the camera when asked.
The Face MIDI app icon: white lips with an orange waveform on graphite