First off, keeping MJD and Forte are no-brainers... you got that part right.
If I understand your league rules correctly, that's a pretty steep price to pay for keeping Brees as well. You would only have 1 pick in the first 5 rounds (round 4), correct? Next pick is in round 6?
Let's assume you don't keep Brees. You would select 6th overall (your 2nd round pick) and take best available player... probably a WR/QB or a RB if you are getting great value. You then get your 3rd round pick, probably in the 10-13 overall range, right? You take another WR/QB. Then BAP with your 4th round pick.
As I don't know who else is being kept throughout your league, you have to evaluate this, but I can't see where the 2nd scenario (i.e. the one that throws back Brees) doesn't end up being the stronger team at the end of the draft. Plus, you get Avery for a 13th round pick... excellent value for a high-upside WR4/WR5.