Gracefully handle 400 and 403 http codes
400 and 403 errors should not be retried https://spec.matrix.org/v1.2/client-server-api/#post_matrixclientv3roomsroomidinvite
400 and 403 errors should not be retried https://spec.matrix.org/v1.2/client-server-api/#post_matrixclientv3roomsroomidinvite