Wimbledon finalist Milos Raonic has joined the list of sports stars skipping next month's Olympics due to concerns over the Zika virus.