Let your agent know that you’re unhappy and the reasons why. It may be a simple misunderstanding that can be corrected. If the issues are more substantial or the relationship simply isn’t the right, tell the agent you no longer wish to work with them. If you have a buyer agency agreement with your agent, you will need to provide a written cancellation of the agreement. Don’t let a less-than-perfect relationship keep you from finding another agent to work with. Buying and selling real estate are complex transactions, and it’s important that you have an agent to represent your best interest.