How do you make an RDS database highly available?

Enable Multi-AZ: a synchronous standby in another AZ with automatic failover to the same endpoint. Read replicas are asynchronous and are for scaling reads (or cross-region DR), not automatic HA.