For real – time interaction. Performer/ spectator, image, video, 3D, sound and network
Applications for real – time interaction.
Design of projects and use of interactive devices of creation for the visual arts.
Node-based visual programming language provided as part of the Xcode development environment in Mac OS X for processing and rendering graphical data.
Quartz Composer OpenGL, Core Image, Core Video, JavaScript, Core Audio and other technologies to build an API and a developer tool around a simple visual programming paradigm.
Deeply embedded into the operating system.
Compositions created in Quartz Composer can be played standalone in any QuickTime-aware application.
Quartz Composer (Quartz Composer) is a technology that exploits the graphics processing unit (GPU) of the host Apple Mac and integrates:
★ graphic standards as defined by Open-GL and Open-GL Shader Language, enabling real-time video, 3D and image processing.
★ with Apple’s Quicktime technology for image handling and dissemination.
★ data aggregation standards defined by RSS and a logic / control language defined by javascript /.
★ osc, midi and audio input processing allowing sophisticated image and composition control by external sources and sensors.
★ with xCode, Apples Integrated Developing Environment (IDE) – allowing Quartz Composer compositions to be embedded in a wider coding environment for more complex control and interoperability.
Quartz Composer is an opportunity for interactive motion graphics artists to explore an interesting early foray into ‘resolution independent’ imaging.
‘Quartz’ is Apple’s brand name for a suite of technologies internally known as ‘core image’ / resolution-independent 2d graphics based on PDF technologies and 3D graphics based on hardware accelerated Open-GL /
OpenGL
(Open Graphics Library) is a standard specification defining a cross-language, API for writing applications that produce 2D and 3D computer graphics. The interface consists of over 250 different function calls which can be used to draw complex three-dimensional scenes from simple primitives. OpenGL was developed by Silicon Graphics Inc. (SGI) in 1992[1] and is widely used in CAD, virtual reality, scientific visualization, information visualization, and flight simulation.
Quartz Composer vs MAX/MSP/Jitter
Quartz Composer is much faster than MAX/MSP for video processing, it’s also free with Tiger and applications made with Quartz Composer can be sold without paying any license fee
Introduction to OSC
Open Sound Control (OSC) is a protocol for communication among computers, sound synthesizers, and other multimedia devices that is optimized for modern networking technology. Bringing the benefits of modern networking technology to the world of electronic musical instruments, OSC’s advantages include interoperability, accuracy, flexibility, and enhanced organization and documentation.
This simple yet powerful protocol provides everything needed for real-time control of sound and other media processing while remaining flexible and easy to implement.
OSC is meant to supersede the MIDI standard, which was defined in 1983 and which many consider inadequate for modern multimedia purposes.
Features:
• Open-ended, dynamic, URL-style symbolic naming scheme
• High-resolution numeric argument data
• Symbolic and high-resolution numeric argument data
• Pattern matching language to specify multiple recipients of a single message
• High resolution time tags
• ”Bundles” of messages whose effects must occur simultaneously
• Query system to dynamically find out the capabilities of an OSC server and get documentation
There are dozens of implementations of OSC, including real-time sound and media processing environments, web interactivity tools, software synthesizers, a large variety programming languages, and hardware devices for sensor measurement. OSC has achieved wide use in fields including computer-based new interfaces for musical expression, wide-area and local-area networked distributed music systems, inter-process communication, and even within a single application.
OSC Application Areas
Real-time sound and media processing environments
Transport-independent protocol which means that it is a format for data that can be carried across a variety of networking technologies.
Inter-process communication.
Sensor/ Gesture-Based Electronic Musical Instruments
New computer-based interfaces for musical expression
Mapping non-musical data to sound
Multiple-User Shared Musical Control
Web interfaces, interactivity tools
Networked LAN Musical Performance
WAN performance and Tele presence
Virtual Reality
Wrapping Other Protocols Inside OSC
The advantages of OSC
over MIDI are primarily speed and throughput; internet connectivity; datatype resolution;
OSC messages arrive as fast as the underlying network stack can transfer them, and can be delayed to take effect at a specific time, whereas MIDI ensures synchronicity of messages by transferring them at a specific clock rate.
Open Sound Control is transmitted on systems with a bandwidth in the 10+ megabit/sec range.
In comparison, the bandwidth of MIDI is only 31.25 kilobit/sec, approximately 300 times slower!
In OSC numeric data is encoded in 32-bit or 64-bit quantities and includes symbolic addressing and time-tag messages.
The numerous advantages, efficiency, low cost and reliability of this new protocol make it a potential replacement for current technology. It will give users more reactive musical control their convenience as well as expand the every growing industry of music technology and the internet.
Read more on OSC: Meta-Language Technique : OSC by Michael Gaio
