who opposed the indian removal act