The President shall, whenever he may judge it expedient, discontinue any Indian agency, or transfer the same, from the place or tribe designated by law, to such other place or tribe as the public service may require.