Flute phone lets electronic music making go wide scale


Ge Wang blows softly, his fingers move lightly, and “Auld Lang Syne” comes floating out in ethereal electronic notes.

Then his instrument rings, so he answers it and starts chattering away.

It’s an iPhone, transformed through Wang’s software genius into an ocarina -- a computerized version of an ancient Aztec flute. Wang, an associate professor of computer music at Stanford University, is the co-founder of SonicMule Inc. The Silicon Valley start-up also known as Smule has sold the Ocarina iPhone application at 99 cents apiece to more than 900,000 people.

To play the Ocarina, you blow into the iPhone’s microphone and press four dots on the touch screen, with different combinations creating different notes.


Wang, 31, came to the endeavor almost accidentally -- more as an artist experimenting in the arcane field of computer music than with any sense of building a business.

“Making music is so satisfying, regardless of the result,” Wang says. “That is mirrored by my love of computer science.”

As a doctoral student at Princeton University and now in his position at Stanford, Wang has put those two fields together, conducting laptop orchestras and, more recently, a mobile phone orchestra known as MoPhO.

But it was only the fortuitous hookup with a student at Stanford’s Center for Computer Research in Music and Acoustics that brought Wang’s innovations out of academia and into the marketplace.

That student was Jeff Smith, a Silicon Valley entrepreneur who is now chief executive of Smule. Smith, 42, had co-founded Tumbleweed, an e-mail security firm, and taken it public. He wanted to put a coda on his computer career and learn to play a perfect Schumann Fantasy on the piano.

“But the only way Stanford was going to let me into a music PhD program was in computer music, because of my background,” Smith said.


The idea initially repelled him. “I thought those guys were a bunch of fruitcakes,” Smith said. “To me, music and computers were two separate things. One was beautiful and expressive, and one was cold and calculating.”

And then Smith sat in as Wang gave a lecture at Stanford. Wang took the podium with his trademark unkempt look -- hair to his shoulders, unbuttoned shirt sleeves, baggy pants -- and played some music on his laptop.

“This sounds corny,” Smith said, “but when I heard him, I felt that music was going to change, and this is the guy who was going to change it.”

Smith began using ChucK -- a programming language that Wang had written at Princeton with his mentor, Perry Cook -- to turn the sounds of lawn mowers, dishwashers, Xbox 360s and other objects into music.

That was in 2007, and the iPhone had just come out. By 2008, Smith approached Wang with the idea for a company. Although Wang says running a start-up was “nowhere in the playbook,” he signed on.

When Apple Inc. announced its software development kit in March 2008, enabling anyone to write applications for the iPhone, Smule was in business. It raised $5.5 million in two rounds of funding from Bessemer Venture Partners, Granite Ventures, Maples Investments and Smith himself.


The company’s name is inspired by science fiction author Isaac Asimov’s main character in “The Mule” who could influence billions of people to change their behavior.

“We want to think about things on that scale,” Wang said.

To that end, Smule’s great innovation may lie in its World Stage, a spinning globe feature that’s part of its applications. It enables users to broadcast their music to others and to hear and rate what others are doing.

“It just helps you feel connected to other iPhone users around the world,” says Tara Hunt, 35, of San Francisco, an author and consultant specializing in Internet community. “It’s about the human experience. It’s just an iPhone app, but it feels so much deeper.”

Ocarina users love to get ideas from each other. Daphne Mir, 17, of Laguna Niguel, a student at Orange County High School of the Arts, amazed her theater teacher with an iPhone rendition of “Can You Feel the Love Tonight?”

Smule sent an iPhone loaded with Ocarina to David Choi, 23, of Fullerton, a musician who has amassed a YouTube following, and he’s put up songs as varied as “Row, Row, Row Your Boat” and Katy Perry’s “Hot N Cold,” complete with guitar and vocal accompaniment.

“It’s not a real ocarina,” Choi said. “But it’s pretty close.”

Encouraging a worldwide community is a big part of Smule’s business plan, Smith said. Users are already uploading sheet music to the Web. Smule’s newest app, the Leaf Trombone: World Stage, which mimics the brass instrument, puts the music right on the phone.


Smule -- with a staff of 12 working out of a cramped conference room in Bessemer’s office in Menlo Park -- has produced other clever iPhone apps. The Sonic Lighter smolders and flickers. Zephyr uses the touch screen to create an Etch a Sketch experience. Sonic Vox gives your voice effects such as Darth Vader and a crying baby. Sonic Boom is a simulated firecracker.

All are 99 cents, except Sonic Vox and Zephyr, at $1.99.

Sonic Boom and Sonic Vox have sold about 150,000 copies each, and the Sonic Lighter has sold 300,000 copies. All indications are that Leaf Trombone will be a hit.

IPhone applications are a hot business. Apple announced last month that the 1 billionth app had been downloaded from its iTunes store, where more than 35,000 are available. An ABI Research study in February found that 17% of U.S. smart-phone users (a category that includes the iPhone, BlackBerry and other devices) have spent $100 to $500 on applications -- sometimes more than they spent on the phone itself.

Although Apple makes it easy to download applications, it also drives down the price, ABI Research analyst Jeff Orr said. Low revenue and a crowded marketplace will create a challenge.

“Being found and discovered as one of 500 apps is different than being one of 25,000,” he said.

Wang was born in China and came to the U.S. with his family at age 9. His father is a professor at a small college in New Jersey and his mother is a cosmetologist.


He picked up accordion at 7 and electric guitar at 13. While his father studied artificial intelligence and statistics, Wang started writing computer programs. He continued with computers at Duke University, where he discovered he could combine it with his love of music.

“Both have a lot to do with aesthetics, with making patterns, finding patterns and exploiting or using those patterns in a way that hopefully, to someone, seems beautiful,” he said. “There’s a lot of beauty to how a program is created and how someone uses it.”