The organising committee said in their Thursday update that two athletes staying in the Olympic Village were among those who tested positive.
Neither are, however, Japanese.
Organisers said two more people from the Olympic Village are affected, but they are not athletes.
All four must now go into quarantine.
The latest numbers bring the total of positive tests since July 1 to 87.