Tennessee is losing two key members of its defensive coaching staff, as coordinator Justin Wilcox and linebackers coach Peter Sirmon have agreed to join Steve Sarkisian's staff at Washington, sources told ESPN.com on Monday.