Bayliss trained in Melbourne, winning a Gallery Art School Scholarship in 1935. Later training in London, after the 1939-45 War, he became a production assistant at Covent Garden Opera House. He returned to Australia in 1965, teaching art in Croydon, Victoria.
The VCA Art Collection spans the entire history of the College and its predecessor, the National Gallery School of Art (first opened in 1867). Comprising painting, sculpture, photography and works on paper, most works are by students, staff or alumni. The Margaret Lawrence Australian Ceramics Collection was bequeathed to the Collection in 2004.