Orange was born in Sweden but made a permanent move to New Orleans in 1966, enjoying immediate acceptance. He began recording within a month of his arrival, working with jazz pioneers such as DeDe Pierce, Kid Thomas Valentine, Percy Humphrey and Jim Robinson. In addition to local clubs, Orange has traveled the jazz festival circuit, playing or recording with Zutty Singleton, Danny Barker, Teddy Wilson, Ray Bauduc, Georg Brunis, Max Kaminsky and Earl Hines. He accompanied Louis Armstrong on his 70th birthday in Newport. Orange has done jazz festivals in Europe, theatre in New York and performed on the sound track of Louis Malle's film Pretty Baby, which was nominated for an Oscar. He was one of the creators of the stage production of One Mo' Time, playing in New York, Australia and London, where he did a command performance for the Queen. He was the musical director of the original cast album that garnered a Grammy nomination. He has also toured frequently with the Preservation Hall Jazz Band. Orange has a unique and identifiable style, unlike that of any other early jazz clarinetist. He is today's standard-bearer of traditional jazz clarinet. Orange maintains residences in New Orleans and New York.