Yes, you are likely to bleed while taking the medication. This bleeding is similar to a period if you started on day 21. If you started the down-regulation on day two of your cycle, you might not have a further bleed, or it may just be light spotting.
