The Hong Kong Government divided the Victoria City into four wan (環), or districts. While West Point falls into the Sai Wan, the Western District, major government structures like the police station and court are located near West Point. Thus the name of Sai Wan, Western District, Western and West Point were sometimes used interchangeably.
References
The detail of this document can be found in Hong Kong Public Records Office