He was the older brother of Jean Dufy. He attended evening art classes in Le Havre and then won  a scholarship to the École des Beaux-Arts in Paris. He was influenced by the Impressionists and the Post- Impressionists, particularly the Fauves. His work is distinct for its strong sense of design, expressive colours and rapid line. The themes of his oils and many watercolours include horse races, regattas and harbours, concerts and society social events. Like his brother, he designed textiles and he also made many book illustrations.