Audio / MIDI

ImageToMIDI QT

0.1.3.16

Experimental image-musical tool for mapping image data to MIDI, MIDI ↔ image reconstruction and working with multiple channels, devices and synchronization offsets.

What the project solves

Experimental image-musical tool for mapping image data to MIDI, MIDI ↔ image reconstruction and working with multiple channels, devices and synchronization offsets.

Typical use

Image conversion ↔ MIDI (image pixel → MIDI note, velocities, channel)
Audio import (MP3 → spectrogram → BMP → MIDI)
MIDI multi-track generation (16 channels, GM / GS standard)
Mapping RGB / Hexadecimal on MIDI parameters
Batch processing (batch PIC → MIDI, MIDI → PIC reconstruction)
Real-time MIDI playback (Windows MCI, Mido)

How the application works and what it is for

Overview

ImageToMIDI _ QT is a robust tool for generating MIDI data from image materials. Supports static images (BMP, PNG, JPG) and dynamic audio-spectrograms (MP3).

Image conversion → MIDI (luma, RGB, layers)
Support MP3 import via FFMPEG (spectrogram of pipeline)
32 channels in two banks (A / B) with full mido routing
Per- device and per- bank offset for precise synchronization of HW synths
Device presets for Korg Volca, Roland TR-8 and MS GS Synth

Functions and Properties

Image Mapping: Pixel conversion to MIDI (Luminance, RGB, layers).
Audio to MIDI: Automatic piperine MP3 → Spectrogram (BMP) → MIDI via FFMPEG.
MIDI Mixer (A / B): The management of 32 channels with separate and shared routing for two banks.
Precise Sync: Per- device and per- bank offset (ms) for perfect phasing of HW and SW synthesis.
Hardware Presets: Presetting and auto detection for Korg Volca, Roland TR-8 and MS GS Wavetable.
NumPy Acceleration: Hardware accelerated pixel analysis for immediate conversion of large images.
Overlay Visualization: Dynamic crosshair and step marker in real time without influence on performance (paintEvent optimization).
Asset Registry: Advanced Lookup System ( → /./. Fallback).
Dual Playback: Combined playing of Windows MCI (Bank A) + Mido routing (Bank B).

Supported formats and standards

Entry data: BMP, PNG, JPG (any resolution), MP3 (requires ffmpeg).

Output: Standard MIDI File (SMF .mid). Support for GM (General MIDI) and GS standards.

Render: Optional export to WAV (via FluidSynth + .sf2 soundfonts).

Application

ImageToMIDI _ QT converts visual information to music data. Work procedure:

Load Image: Loading a raster image (PNG, JPG, BMP).
Mapping: Selection of the mode (Luminance, RGB channels, layers).
Quantization: Limiting tones to a specific musical range and range of notes.
Export: Generating standard MIDI file (.mid).

Troubleshooting

graphical interface Laying: If lags occur, make sure you do not use legacy and assets you have in modern structures.
Numbers missing: The application will run even without NumPa, but the conversion process will be significantly slower for large images.

The total amount of the funding received shall be reported in column 060.

Does the application support multiple tracks? Yes, in multi-track mode you can map different colors (RGB) into separate MIDI channels.

How does the fastain work? The fastain is calculated from the continuity of brightness in the horizontal or vertical axis of the picture.

Current branch 0.1.3.16

The newer branch continues to map the image to music data and in two-way experiments MIDI ↔ image. Multi-channel GM / GS routing, bank management, MIDI equipment and synchronization offsets for software and hardware synthesizers remain an important part. The application is part of a wider experimental MIDI workflow alongside VMS and Wave Generator.

The public documentation describes the result and workflow; internal widgets, asset registers and individual handlers are removed from the profile.