Frequency modulation synthesis

In synthesizers Digital FM synthesis (equivalent to phase modulation using the time integration of instantaneous frequency) was the basis of several musical instruments beginning as early as 1974. Yamaha built the first prototype digital synthesizer in 1974, based on FM synthesis, Yamaha's groundbreaking Yamaha DX7 synthesizer, released in 1983, brought FM to the forefront of synthesis in the mid-1980s. In PCs, arcades, game consoles, and mobile phones FM synthesis also became the usual setting for games and software up until the mid-nineties. Sound cards for IBM PC compatible systems like the AdLib and Sound Blaster popularized Yamaha chips like the OPL2 and OPL3. Other computers such as the Sharp X68000 and MSX (Yamaha CX5M computer unit) utilize the OPM sound chip (with later CX5M units using the OPP sound chip). The NEC PC-88 and PC-98 computers use either the OPN and OPNA sound chips. For arcade systems and game consoles, OPM was used in many arcade boards from the 1980s and 1990s (including Sega's System 16 and Capcom's CP System arcade boards); OPN was also used in some arcade boards in the 1980s. OPNB was notably used in SNK's Neo Geo arcade (MVS) and home console (AES) machines, as well as being used as the main basic sound generator in Taito's arcade boards (with a variant of the OPNB being used in the Taito Z System board). The related OPN2 was used in Sega's Mega Drive (Genesis), Fujitsu's FM Towns Marty, and some of Sega's arcade boards (e.g. Sega System C-2 and Sega System 32) as one of its sound generator chips. FM synthesis was also used on a wide range of mobile phones in the 2000s to play ringtones and other sounds, using the Yamaha SMAF format. ==History==

Don Buchla (mid-1960s) Don Buchla implemented FM on his instruments in the mid-1960s, prior to Chowning's patent. His 158, 258 and 259 dual oscillator modules had a specific FM control voltage input, and the model 208 (Music Easel) had a modulation oscillator hard-wired to allow FM as well as AM of the primary oscillator. These early applications used analog oscillators, and this capability was also followed by other modular synthesizers and portable synthesizers including Minimoog and ARP Odyssey. John Chowning (late-1960s–1970s) By the mid-20th century, frequency modulation (FM), a means of carrying sound, had been understood for decades and was being used to broadcast radio transmissions. FM synthesis was developed since 1967 at Stanford University, California, by John Chowning, through his exploration of digital synthesis and spatialization, inspired by the new possibilities of digital sound as described by Max Mathews. His algorithm was licensed to Japanese company Yamaha in 1973. The implementation commercialized by Yamaha (US Patent 4018121 Apr 1977 or U.S. Patent 4,018,121) is actually based on phase modulation, but the results end up being equivalent mathematically as . 1970s–1980s Expansions by Yamaha Yamaha's engineers began adapting Chowning's algorithm for use in a commercial digital synthesizer, adding improvements such as the "key scaling" method to avoid the introduction of "distortion that normally occurred in analog systems during frequency modulation", though it would take several years before Yamaha released their FM digital synthesizers. In the 1970s, Yamaha were granted a number of patents, under the company's former name "Nippon Gakki Seizo Kabushiki Kaisha", evolving Chowning's work. FM synthesis was the basis of some of the early generations of digital synthesizers, most notably those from Yamaha, as well as New England Digital Corporation under license from Yamaha. From the mid 1980s onward, Yamaha began installing cheaper implementations of the FM synthesis tone generation system in its consumer grade PortaSound/PortaTone home keyboards. Yamaha had patented its hardware implementation of FM in the 1970s, Today, FM is mostly found in software-based synths such as Native Instruments' FM8 or Image-Line's Sytrus plug-ins, but it has also been incorporated into the synthesis repertoire of some modern digital synthesizers, usually coexisting as an option alongside other methods of synthesis such as subtractive, sample-based synthesis, additive synthesis, and other techniques. The degree of complexity of the FM in such hardware synths may vary from simple 2-operator FM, to the highly flexible 6-operator engines of the Korg Kronos and Alesis Fusion, to creation of FM in extensively modular engines such as those in the latest synthesisers by Kurzweil Music Systems. Later use of FM and other technologies: Realtime Convolution & Modulation (AFM + Sample) and Formant Shaping Synthesis The Yamaha SY99 and FS1R synthesizers marketed their highly powerful FM abilities as counterparts to sample-based synthesis and formant synthesis respectively. New hardware synths specifically marketed for their FM capabilities disappeared from the market after the release of FS1R in 1999, The FS1R had 16 operators, 8 standard FM operators and 8 additional operators that used a noise source rather than an oscillator as its sound source. By adding in tuneable noise sources the FS1R could model the sounds produced in the human voice and in a wind instrument, along with making percussion instrument sounds. The FS1R also contained an additional wave form called the Formant wave form. Formants can be used to model resonating body instrument sounds like the cello, violin, acoustic guitar, bassoon, English horn, or human voice. Formants can even be found in the harmonic spectrum of several brass instruments. Korg has also released the opsix (2020) and opsix SE (2023), integrating 6 operators FM synthesis with subtractive, analogue modeling, additive, semi-modular and Waveshaping. Yamaha released the Montage in 2016, which combines a 128-voice sample-based engine with a 128-voice FM engine. This iteration of FM is called FM-X, and features 8 operators; each operator has a choice of several basic wave forms, but each wave form has several parameters to adjust its spectrum. It was then followed by the more affordable Yamaha MODX in 2018, with 64-voice, 8 operators FM-X architecture in addition to a 128-voice sample-based engine. The MODX+ released in 2022 increased the number of voices of the FM-X engine to 128, the same as with the Montage. The Montage was succeeded by the Montage M in 2023, which uses the same 128-voice, 8 operators FM-X engine alongside a 128-voice sample-based engine and a newly introduced 16-voice 3 oscillator analog-based engine known as AN-X. Elektron launched the Digitone in 2018, which is an 8-voice, 4 operators FM synth featuring Elektron's renowned sequence engine. FM-X synthesis was first introduced with the Yamaha Montage synthesizers in 2016. FM-X uses 8 operators. Each FM-X operator has a set of multi-spectral wave forms to choose from, which means each FM-X operator can be equivalent to a stack of 3 or 4 DX7 FM operators. The list of selectable wave forms includes sine waves, the All1 and All2 wave forms, the Odd1 and Odd2 wave forms, and the Res1 and Res2 wave forms. The sine wave selection works the same as the DX7 wave forms. The All1 and All2 wave forms are a saw-tooth wave form. The Odd1 and Odd2 wave forms are pulse or square waves. These two types of wave forms can be used to model the basic harmonic peaks in the bottom of the harmonic spectrum of most instruments. The Res1 and Res2 wave forms move the spectral peak to a specific harmonic and can be used to model either triangular or rounded groups of harmonics further up in the spectrum of an instrument. Combining an All1 or Odd1 wave form with multiple Res1 (or Res2) wave forms (and adjusting their amplitudes) can model the harmonic spectrum of an instrument or sound. Combining sets of 8 FM operators with multi-spectral wave forms was first introduced in the FS1R, released in 1999 by Yamaha. It was able to achieve similar results to that of FM-X using 8 noise operators. == Spectral analysis ==

There are multiple variations of FM synthesis, including: • Various operator arrangements (known as "FM Algorithms" in Yamaha terminology) • 2 operators • Serial FM (multiple stages) • Parallel FM (multiple modulators, multiple-carriers), • Mix of them • Various waveform of operators • Sinusoidal waveform • Other waveforms • Additional modulation • Linear FM • Exponential FM (preceded by the anti-logarithm conversion for CV/oct. interface of analog synthesizers) • Oscillator sync with FM etc. As the basic of these variations, we analyze the spectrum of 2 operators (linear FM synthesis using two sinusoidal operators) on the following. 2 operators The spectrum generated by FM synthesis with one modulator is expressed as follows: For modulation signal m(t) = B\,\sin(\omega_m t)\,, the carrier signal is: :\begin{align} FM(t) & \ =\ A\,\sin\left(\,\int_0^t \left(\omega_c + B\,\sin(\omega_m\,\tau)\right)d\tau\right) \\ & \ =\ A\,\sin\left(\omega_c\,t - \frac{B}{\omega_m}\left(\cos(\omega_m\,t) - 1\right)\right) \\ & \ =\ A\,\sin\left(\omega_c\,t + \frac{B}{\omega_m}\left(\sin(\omega_m\,t - \pi/2) + 1\right)\right) \\ \end{align} If we were to ignore the constant phase terms on the carrier \phi_c = B/\omega_m\, and the modulator \phi_m = - \pi/2\,, finally we would get the following expression, as seen on and : :\begin{align} FM(t) & \ \approx\ A\,\sin\left(\omega_c\,t + \beta\,\sin(\omega_m\,t)\right) \\ & \ =\ A\left( J_0(\beta) \sin(\omega_c\,t) + \sum_{n=1}^{\infty} J_n(\beta)\left[\,\sin((\omega_c+n\,\omega_m)\,t)\ +\ (-1)^{n}\sin((\omega_c-n\,\omega_m)\,t)\,\right] \right) \\ & \ =\ A\sum_{n=-\infty}^{\infty} J_n(\beta)\,\sin((\omega_c+n\,\omega_m)\,t) \end{align} where \omega_c\,,\,\omega_m\, are angular frequencies (\,\omega = 2\pi f\,) of carrier and modulator, \beta = B / \omega_m\, is frequency modulation index, and amplitudes J_n(\beta)\, is n\,-th Bessel function of first kind, respectively. ==See also==