Joe was the son of Wing Soon Joe and grew up working in the family's landmark restaurant with his siblings Suelin, George, John, and Jimmy. He attended Shades Valley High School and the University of Montevallo, and served in the Air National Guard.
As owner of Joy Young, Joe himself made the restaurant's famous egg rolls. After the downtown restaurant closed he reopened in the Brookwood Gallery, a retail strip on the ground floor of the Brookwood Medical Center parking deck, where it operated for several more years. Later he continued making egg rolls for a take-out only version of Joy Young in Pelham.
Joe died in 2020 after a battle with ataxia.