You'd need a 5 pole relay, as there are red,green, blue, vsync and hsync signals that all need to be switched.
A commerical kvm or monitor switch might be a better option.
Solid state relays tend to use thyristors or triacs, and are not particularly suited for video signals, though I dare say its possible.