Filhos: Stefan Kendal Gordy, Rhonda Ross Kendrick, Berry Gordy IV, Hazel Gordy, Rockwell, Kerry Gordy, Sherry Gordy, Terry James Gordy
Cônjuge: Grace Eaton (de 1990 a 1993), Ray Singleton (de 1960 a 1964), Thelma Coleman (de 1953 a 1959)
Irmãos: Anna Gordy Gaye, Gwen Gordy Fuqua, Fuller Berry Gordy, Robert Gordy, Esther Gordy Edwards, George Gordy, Loucye Gordy Wakefield