Does APIG Support Multiple Backend Endpoints?

Yes

APIG supports the configuration of multiple backend endpoints through a VPC channel (also called "load balance channel"). You can add multiple cloud servers to each VPC channel.

For details, see section "Creating a VPC Channel (Load Balance Channel)" in the API Gateway User Guide.