You can upload product images by REST API Magento with the PUT action and the help of /V1/products/<sku>.
Action: PUT
URL: <BASE_URL>/rest/V1/products/<SKU>
(Example URL: https://magento.test/rest/V1/products/my-sku)
Header: Authorization: Bearer <ADMIN TOKEN>