The aQWERTYon pitch wheels and the future of music theory visualization

The MusEDLab will soon be launching a revamped version of the aQWERTYon with some enhancements to its visual design, including a new scale picker. Beyond our desire to make our stuff look cooler, the scale picker represents a challenge that we’ve struggled with since the earliest days of aQW development. On the one hand, we want to offer users a wide variety of intriguing and exotic scales to play with. On the other hand, our audience of beginner and intermediate musicians is likely to be horrified by a list of terms like “Lydian dominant mode.” I recently had the idea to represent all the scales as colorful icons, like so:

Read more about the rationale and process behind this change here. In this post, I’ll explain what the icons mean, and how they can someday become the basis for a set of new interactive music theory visualizations.

Musical pitches rise and fall linearly, but pitch class is circular. When you go up or down the chromatic scale, the note names “wrap around” every twelve notes. This naming convention reflects the fact that we hear notes an octave apart as being “the same”, probably because they share so many overtones. (Non-human primates hear octaves as being equivalent too.)

chromatic circle

The note names and numbers are all based on the C major scale, which is Western music’s “default setting.” The scale notes C, D, E, F, G, A and B (the white keys on the piano) are the “normal” notes. (Why do they start on C and not A? I have no idea.) You get D-flat, E-flat, G-flat, A-flat and B-flat (the black keys on the piano) by lowering (flatting) their corresponding white key notes. Alternately, you can get the black key notes by raising or sharping the white key notes, in which case they’ll be called C-sharp, D-sharp, F-sharp, G-sharp, and A-sharp. (Let’s just briefly acknowledge that the imagery of the “normal” white and “deviant” black keys is just one of many ways that Western musical culture is super racist, and move on.)

You can represent any scale on the chromatic circle just by “switching” notes on and off. For example, if you activate the notes C, D, E-flat, F, G, A-flat and B, you get C harmonic minor. (Alternatively, you could just deactivate D-flat, E, G-flat, A, and B-flat.) Here’s how the scale looks when you write it this way:

C harmonic minor - monochrome

This is how I conceive scales in my head, as a pattern of activated and deactivated chromatic scale notes. As a guitarist, it’s the most intuitive way to think about them, because each box on the circular grid corresponds to a fret, so you can read the fingering pattern right off the circle. When I think “harmonic minor,” I don’t think of note names, I think “pattern of notes and gaps with one unusually wide gap.”

Another beauty of the circle view is that you can get the other eleven harmonic minor scales just by rotating the note names while keeping the pattern of activated/deactivated notes the same. If I want E-flat harmonic minor, I just have to grab the outer ring and rotate it counterclockwise a few notches:

E-flat harmonic minor

My next thought was to color-code the scale tones to give an indication of their sound and function:

C harmonic minor scale necklace

Here’s how the color scheme works:

  • Green – major, natural, sharp, augmented
  • Blue – minor, flat, diminished
  • Purple – perfect (neither major nor minor)
  • Grey – not in the scale

Scales with more green in them sound “happier” or brighter. Scales with more blue sound “sadder” or darker. Scales with a mixture of blue and green (like harmonic minor) will have a more complex and ambiguous feeling.

My ambition with the pitch wheels is not just to make the aQWERTYon’s scale menu more visually appealing. I’d eventually like to have it be an interactive way to visualize chords too. Followers of this blog will notice a strong similarity between the circular scale and the rhythm necklaces that inspired the Groove Pizza. Just like symmetries and patterns on the rhythm necklace can tell you a lot about how beats work, so too can symmetries and patterns on the scale necklace can tell you how harmony works. So here’s my dream for the aQWERTYon’s future theory visualization interface. If you load the app and set it to C harmonic minor, here’s how it would look. To the right is a staff notation view with the appropriate key signature.

When you play a note, it would change color on the keyboard and the wheel, and appear on the staff. The app would also tell you which scale degree it is (in this case, seven.)

If you play two notes simultaneously, in this case the third and seventh notes in C Mixolydian mode, the app would draw a line between the two notes on the circle:

If you play three notes at a time, like the first, fourth and fifth notes in C Lydian, you’d get a triangle.

If your three notes spell out a chord, like the second, fourth and sixth notes in C Phrygian mode, the app would recognize it and shows the chord symbol on the staff.

The pattern continues if you play four notes at a time:

Or five notes at a time:

By rotating the outer ring of the pitch wheel, you could change the root of the scale, like I showed above with C harmonic minor. And if you rotated the inner ring, showing the scale degrees, you could get different modes of the scale. Modes are one of the most difficult concepts in music theory. That is, they’re difficult until you learn to imagine them as rotations of the scale necklace, at which point they become nothing harder than a memorization exercise.

I’m designing this system to be used with the aQWERTYon, but there’s no reason it couldn’t take ordinary MIDI input as well. Wouldn’t it be nice to have this in a window in your DAW or notation program?

Music theory is hard. There’s a whole Twitter account devoted to retweeting students’ complaints about it. Some of this difficulty is due to the intrinsic complexity of modern harmony. But a lot of it is due to terminology and notation. Our naming system for notes and chords is a set of historically contingent kludges. No rational person would design it this way from the ground up. Thanks to path dependency, we’re stuck with it, much like we’re stuck with English grammar and the QWERTY keyboard layout. Fortunately, technology gives us a lot of new ways to make all the arcana more accessible, by showing multiple representations simultaneously and by making those representations discoverable through playful tinkering.

Do you find this idea exciting? Would you like it to be functioning software, and not just a bunch of flat images I laboriously made by hand? Help the MusEDLab find a partner to fund the developer and designer time. A grant or gift would work, and we’d also be open to exploring a commercial partnership. The aQW has been a labor of volunteer love for the lab so far, and it’s already one of the best music theory pedagogy tools on the internet. But development would go a lot faster if we could fund it properly. If you have ideas, please be in touch!

Update: Will Kuhn’s response to this post.

People of the MusEDLab: Jamie Ehrenfeld


Jamie Ehrenfeld

EMPATHETIC

t. @artseducation

i. @jamieehrenfeld

Currently Student, Alum Partner & Educator.


 

 What project are you currently working on?

The Ed Sullivan Fellows Program! It’s a community arts mentorship lab, designed in the ethos of MusEDLab as a whole, that supports young musicians growing up in New York City as they explore, build, and launch creative careers.

What do you like about working at MusEDLab? 

The lab has always felt like home for me. Having grown up with the lab over the past four years, the opportunity to learn and evolve with such a brilliant interdisciplinary team has drastically impacted the way I relate to my work and what is possible.

What excites about music education and technology? 

How each (music, education, and technology) influence one another as they evolve separately and as intersecting domains. How humans with different experiences and contexts relate to music, education, and technology, and how these human contexts influence how we develop tools and resources.
What advice would you give to prospective students at MusEDLab?

Get ready to choose (+create) your own adventure!

Your current favorite song?

Devastated by Joey Bada$$

 

People of the MusEDLab: Yilu Guo


Yilu Guo

DREAMER, CREATOR, DOER

f. yilu.guo

Currently a Staff/faculty

 

 


 What project are you currently working on?

MusEDLab International Expansion Plan; Meditation Album “In the Bamboo Forest”

What do you like about working at MusEDLab? 

 

Self-directory working environment; Everybody here is being really supportive to each other; Never stop exploring new things; You will always get inspired.

What excites about music education and technology?

How to design project-based interdisciplinary music education by leveraging the new tech?

Your current favorite song?

“La Vie En Rose” by Melody Gardot


People of the MusEDLab: Martin Urbach


Martin Urbach

ACTIVISM, LIBERATION, ENJOYMENT

f. Martin Urbach

t. @mrmartinisays

Educator

 


What project are you currently working on?

I am working on creating a comprehensive curriculum that is informed by critical pedagogy, informal music learning, social justice activism, youth development, anti racist practices and adaptive technology for learners of all abilities.

What do you like about working at MusEDLab? 

 

The people are mighty brilliant, amazing, giving, warm and funny.

What excites about music education and technology?

We are in fertile ground to revitalize that which is stagnant, revive that which is dead and heal that which is broken in music education. We have the tools and we have the people and we have the technology AND we have the students. Now we just have to do it, together.

Your current favorite song?

“Freedom” by Beyonce ft. Kendrick Lamar


People of the MusEDLab: Sumanth Srinivasan


Sumanth Srinivasan

RADIOHEAD, IS, AMAZING

t. @reckoner165

Alumni

 

 


What project are you currently working on?

I’m currently working on a physical game that personifies internet protocols into Kafkaesque role playing.

What did you like about working at MusEDLab? 

A very friendly atmosphere and freedom to pick and choose the work I can commit to. Also leeway to learn on the job.

What excites about music education and technology? 

I learnt music informally and almost exclusively via internet and computers. I see it has come a long way. I’m always excited to give back to this community.

What advice would you give to prospective students at MusEDLab?

Pick a field you don’t know too well and feel your way through it. It’s very gratifying.

Your current favorite song?

Soon by My Bloody Valentine


People of the MusEDLab: Sunny Choi


Sunny Choi

CURIOUS, DRIVEN, RESILIENT

f. sunnychoimusic

t. @thesunnychoi

Currently a Student

 

 


 

What project are you currently working on?

I’m currently working on developing an online music course in partnership with Soundfly, where I take

the course subscribers through my creative process for reinterpreting songs from today’s latest popular music as solo piano music.

As an active member of MusEDLab all throughout the summer, I’m on the committee team to prepare for the launch of our annually-hosted IMPACT Conference that’s to be held from August 1-5. Our conference theme this year is on music experience design for education, health, interactive media and social impact.

I’m also active as Steinway & Son’s popular music recording artist for Spirio pianos, providing my uniquely interpreted solo piano music on today’s popular music

What do you like about working at MusEDLab? 

I consider MusEDLab as my “safe space”, where I feel entirely free to explore all of my curiosities that are related to music. Music is not just some abstract subject that is to remain exclusive amongst certain individuals, but a powerful path that contributes to the development of one’s being. At the lab, I invest time in getting to know cool people that are doing innovative things with music. Some of these people may include educators that are embedding technology in their classrooms, physicians that are interested in connecting the brain activity of music with medicine, and technology companies that passionately care for developing tools for music learning for people in the 21st century. The definition of music is rapidly changing with the evolvement in technology, and it could not be a more exciting period than now to research and explore how music is experienced today.

Your current favorite song?

“Brand New” Day by Hiromi


 

People of the MusEDLab: Ethan Hein


Ethan Hein

DOCTORAL FELLOW, ADJUNCT

t. @ethanhein

Currently a Student

 

 


What project are you currently working on?

All things Groove Pizza and aQWERTYon, creative music making curriculum, Soundfly

What do you like about working at MusEDLab? 

Getting to realize some longstanding dreams about creating great music making and learning tools.

What excites about music education and technology? 

My most meaningful music education has come about through creative experimentation with software and it’s an experience I’m eager to share with more people.

Your current favorite song?

“Cranes In The Sky” by Solange.


Groove challenges with the Groove Pizza

One of our key design principles at the NYU MusEDLab is not to confront beginners with a blank canvas. We want to introduce people to our tools by giving them specific, real-world music to play around with. That was the motivation behind creating presets for the aQWERTYon, and a similar impulse informs Ableton’s approach to their online music tutorials. The Groove Pizza comes with some preset patterns (specials), but there aren’t direct prompts for creative beatmaking. This post introduces some prototype prompts.

Groove Pizza logo

The Funky Drummer boom-bap challenge

The pattern below is the first quarter note of the kick and snare pattern in Clyde Stubblefield’s classic drum break. Fill in the missing kick and snare hits to make your own golden age breakbeat. Try removing some hi-hats as well.

Musical inspiration:

The Levee break asymmetrical kick challenge

The groove below uses the kick and snare pattern from “When The Levee Breaks” by Led Zeppelin. Add hi-hats and customize the kick and snare to best convey the Awesome Majesty of Rock.

Musical inspiration:

Four-on-the-floor squares challenge

These two squares make a classic dance beat, kicks on the quarter notes with hi-hats in between. Add snares and break up the symmetry to make a dance floor filler.

Musical inspiration:

So Fresh So Clean challenge

The pattern below is the basis for a sixteenth note hip-hop groove. Place more kicks and snares to make a crunk Dirty South beat in the spirit of OutKast.

Musical inspiration:

It’s A Trap challenge

The pattern below is the basis for a thirty-second note groove. Add kicks and snares and remove hi-hats to make a radio-friendly trap beat.

Musical inspiration: I would include a link to a Future song but can’t find one that whose lyrics aren’t extremely objectionable. Just turn on the radio.

Careless Whisper

 The infamous saxophone riff in “Careless Whisper” is one of the most infectious earworms in musical history. Love it or hate it, there is no getting it out of your head. In honor of the late George Michael, let’s take a look at what makes it work.
careless-whisper-midi


Play the riff yourself using your computer keyboard!

Press these keys to get the riff:Careless Whisper aQW score
So why is the riff so impossible to forget? Its melodic structure certainly jumps right out at you. The first three phrases are descending lines spelling out chords using similar rhythms. The fourth phrase is an ascending line running up a scale, using a very different rhythm.

First let’s take a closer look at those rhythms. The first three phrases are heavily syncopated. After the downbeats, every single note in each pattern falls on a weak beat. The fourth phrase is less syncopated; it’s a predictable pattern of eighth notes. But because your ear has become used to the pattern of the first three phrases, the straighter rhythm in the fourth one feels more “syncopated” because it defies your expectation.

Now let’s consider the harmonic content. The left diagram below shows the D natural minor scale on the chromatic circle. The right diagram shows it on the circle of fifths. Scale tones have a white background, while non-scale tones are greyed out.

Three of the four phrases in the “Careless Whisper” riff are arpeggios, the notes from a chord played one at a time. Here’s how you make the chords.

  • Take the D natural minor scale. Start on the root (D). Skip the second (E) and land on the third (F). Skip the fourth (G) and land on the fifth (A). Skip the sixth (B-flat) and land on the seventh (C). Finally, skip the root (D) and land on the ninth (E). These pitches – D, F, A, C, and E – make a D minor 9 (Dm9) chord. Now look at the first bar of the sax riff. All the pitches in D minor 9 are there except for C.
  • If you do the same process, but starting on G, you get the pitches G, B-flat, D, F, A, C, which make up a G minor 11 chord. The second phrase has most of those pitches.
  • Do the same process starting on B-flat, and you get B-flat, D, F, and A, making a B-flat major 7 (B♭maj7) chord. The third phrase has all of these pitches.

Careless Whisper D natural minor scale chords

The fourth phrase is different from the others. Rather than outlining an arpeggio, it runs up the D natural minor scale from A to A. This sequence of pitches (A, B-flat, C, D, E, F, G, A) is also known as the A Phrygian mode. The half-step interval between A and B-flat gives Phrygian its exotic quality.

This riff certainly is catchy. It’s also notoriously corny, and to many people’s ears, quite annoying. Why? Some of it is the timbre. The use of unrestrainedly passionate alto sax through heavy reverb was briefly in vogue in the 1980s, and then fell permanently out of style. To my ears, though, the real problem is the chord progression. In D minor, both Gm11 and B♭maj7 are subdominants, and functionally they’re interchangeable. Jazz musicians like me hear them as being essentially the same chord. It would be hipper to replace the Gm with G7, or the B♭maj7 with B♭7. The A minor in the last bar is weak too; it would be more satisfying to replace the C with C-sharp, to make D harmonic minor. But your mileage may vary.

Enjoy my mashup of this track with “Calabria 2007” by Enur featuring Natasja.

Freedom ’90

Since George Michael died, I’ve been enjoying all of his hits, but none of them more than this one. Listening to it now, it’s painfully obvious how much it’s about George Michael’s struggles with his sexual orientation. I wonder whether he was being deliberately coy in the lyrics, or if he just wasn’t yet fully in touch with his identity. Being gay in the eighties must have been a nightmare.

This is the funkiest song that George Michael ever wrote, which is saying something. Was he the funkiest white British guy in history? Quite possibly. 

The beat

There are five layers to the drum pattern: a simple closed hi-hat from a drum machine, some programmed bongos and congas, a sampled tambourine playing lightly swung sixteenth notes, and finally, once the full groove kicks in, the good old Funky Drummer break. I include a Noteflight transcription of all that stuff below, but don’t listen to it, it sounds comically awful.

George Michael uses the Funky Drummer break on at least two of the songs on Listen Without Prejudice Vol 1. Hear him discuss the break and how it informed his writing process in this must-watch 1990 documentary.

The intro and choruses

Harmonically, this is a boilerplate C Mixolydian progression: the chords built on the first, seventh and fourth degrees of the scale. You can hear the same progression in uncountably many classic rock songs.

C Mixolydian chords

For a more detailed explanation of this scale and others like it, check out Theory For Producers.

The rhythm is what makes this groove so fresh. It’s an Afro-Cuban pattern full of syncopation and hemiola. Here’s an abstraction of it on the Groove Pizza. If you know the correct name of this rhythm, please tell me in the comments!

The verses

There’s a switch to plain vanilla C major, the chords built on the fifth, fourth and root of the scale.

C major chords

Like the chorus, this is standard issue pop/rock harmonically speaking, but it also gets its life from a funky Latin rhythm. It’s a kind of clave pattern, five hits spread more or less evenly across the sixteen sixteenth notes in the bar. Here it is on the Groove Pizza.

The prechorus and bridge

This section unexpectedly jumps over to C minor, and now things get harmonically interesting. The chords are built around a descending chromatic bassline: C, B, B-flat, A. It’s a simple idea but with complicated implications, because it implies four chords built on three different scales between them. First, we have the tonic triad in C natural minor, no big deal there. Next comes the V chord in C harmonic minor. Then we’re back to C natural minor, but with the seventh in the bass. Finally, we go to the IV chord in C Dorian mode. Really, all that we’re doing is stretching C natural minor to accommodate a couple of new notes, B natural in the second chord, and A natural in the fourth one.

C minor - descending chromatic bassline

The rhythm here is similar but not identical to the clave-like pattern in the verse–the final chord stab is a sixteenth note earlier. See and hear it on the Groove Pizza.

I don’t have the time to transcribe the whole bassline, but it’s absurdly tight and soulful. The album credits list bass played both by Deon Estus and by George Michael himself. Whichever one of them laid this down, they nailed it.

Song structure

“Freedom ’90” has an exceedingly peculiar structure for a mainstream pop song. The first chorus doesn’t hit until almost two minutes in, which is an eternity–most pop songs are practically over that that point. The graphic below shows the song segments as I marked them in Ableton.

Freedom '90 structure

The song begins with a four bar instrumental intro, nothing remarkable about that. But then it immediately moves into an eight bar section that I have trouble classifying. It’s the spot that would normally be occupied by verse one, but this part uses the chorus harmony and is different from the other verses. I labeled it “intro verse” for lack of a better term. (Update: upon listening again, I realized that this section is the backing vocals from the back half of the chorus. Clever, George Michael!) Then there’s an eight bar instrumental break, before the song has really even started. George Michael brings you on board with this unconventional sequence because it’s all so catchy, but it’s definitely strange.

Finally, twenty bars in, the song settles into a more traditional verse-prechorus-chorus loop. The verses are long, sixteen bars. The prechorus is eight bars, and the chorus is sixteen. You could think of the chorus as being two eight bar sections, the part that goes “All we have to do…” and the part that goes “Freedom…” but I hear it as all one big section.

After two verse-prechorus-chorus units, there’s a four bar breakdown on the prechorus chord progression. This leads into sixteen bar bridge, still following the prechorus form. Finally, the song ends with a climactic third chorus, which repeats and fades out as an outtro. All told, the song is over six minutes. That’s enough time (and musical information) for two songs by a lesser artist.

A word about dynamics: just from looking at the audio waveform, you can see that “Freedom ’90” has very little contrast in loudness and fullness over its duration. It starts sparse, but once the Funky Drummer loop kicks in at measure 13, the sound stays constantly big and full until the breakdown and bridge. These sections are a little emptier without the busy piano part. The final chorus is a little bigger than the rest of the song because there are more vocals layered in, but that still isn’t a lot of contrast. I guess George Michael decided that the groove was so hot, why mess with it by introducing contrast for the sake of contrast? He was right to feel that way.