A general-purpose visual sonification TouchDesigner component by Function Store (Daniel Molnar) (@function.str; [email protected]).

IMPORTANT NOTICE: The component does not work out-of-the box on Mac machines due to the lack of td_pip support. You can still install the dependency manually to your machine probably.

Glossary

• Sonification: The process of converting data or information into sound or audible signals to facilitate analysis or understanding of complex patterns or phenomena.
• Sampling: The process of obtaining the color values of specific pixels in an image.
• VST: Short for Virtual Studio Technology, is a software interface standard used to integrate audio synthesizer and effect plugins with audio editors and recording systems.
  • You can run VSTs in TouchDesigner or any DAW (Reaper is a good free one)
• MIDI: Musical Instrument Digital Interface, is a technology that allows musical instruments and computers to exchange information such as pitch, tempo, and volume, enabling them to create and control music together.
  • MIDI notes have pitch and velocity.
  • Can control VSTs with it, or hardware synthesizers.
• Scale Mode: Variations of a musical scale that start on different notes but follow the same overall pattern, providing different emotional flavors or moods to the music.
• Root Note: The first and primary note of a musical scale or chord from which the rest of the notes are derived, often providing the foundational pitch that defines the key of a piece of music.

Getting Started

• This component allows you to sonify TOPs in TouchDesigner. It is a “general-purpose” component armed with everything you might need for that, but this comes at the cost of complexity, so see the next point.
• Please read this documentation carefully and see my demonstration video: <LINK>
• TopToMidi_DEMO.toe will get you started with some examples.
• If the component shows an error on startup, just disable and re-enable cooking, or right click and Clear (Children) Script Errors
  • Otherwise contact [email protected]

Input slots

1. The only input slot of the component is the TOP to be sampled.

Parameters

The only input slot of the component is the TOP to be sampled.