The Bucks boycott also affects the Houston Rockets' games against the Oklahoma City Thunder and the Los Angeles Lakers' game against the Portland Trail Blazers.
"We are tired of the killings and the injustice," said Bucks guard George Hill, explaining his team's decision to ESPN.
The Bucks were scheduled to play the Magic this afternoon at the AdventHealth Arena, inside the NBA 'bubble' at the Walt Disney World Resort. They refused to leave their locker room before the game, while NBA officials were outside to find out the reasons for their decision.
Some players, including Cuban-American center Brook Lopez, warmed up before the game.
But when it was time for the team to speak, about 15 minutes before tip-off, only the Orlando players and the referees spoke.
There was no activity at all from the Bucks players and coaches.
This action comes after Jacob Blake, a 29-year-old black man, was shot seven times in the back by a white police officer in Kenosha, Wisconsin, about 65 kilometers north of Milwaukee, when he was trying to stop him. Blake is in critical condition.
Blake was shot as he tried to enter the driver's side door of his vehicle with his three children inside. The video of the shooting was distributed on social media.