If a recipient uses grant amounts to provide affordable housing under this subchapter, and at any time during the useful life of the housing the recipient does not comply with the requirement under section 4135(a)(2) of this title, the Secretary shall take appropriate action under section 4161(a) of this title.