No, you should not be worried.
At one week post op, there is always lots of swelling, which may different from one side to the other. This could account for much of your concern.
You are facing many months of healing. Best to voice your concerns with your surgeon -- but I am sure he/she will tell you to be patient and allow the healing to progress.
On the other hand, if you have an indentation at 6 months after surgery, then that may be a more permanent problem and should warrant a visit to your surgeon.
Dr Jacobs