There is no question of controversy about this:
- No one claims that the Sabbath was changed to Sunday.
- Everyone admits that the official day of rest was moved from the Sabbath to Sunday.
- There's nothing specific to the SDA church in this issue, other than that they believe humans do not have authority to change God's laws.
Here are a few quotations from Wikipedia (many many more can be found elsewhere):
Protestant churches admit that Sunday as a day of rest is non-biblical:
Lutheran church historian Augustus Neander states "The festival of Sunday, like all other festivals, was always only a human ordinance".
— Sabbath in Christianity - Wikipedia
The Catholic church claims that it moved the day of rest to Sunday:
Cardinal James Gibbons affirmed Sunday observances as one of the examples of the Roman Catholic Church's sufficiency as guide:
Now the Scriptures alone do not contain all the truths which a Christian is bound to believe, nor do they explicitly enjoin all the duties which he is obliged to practice. Not to mention other examples, is not every Christian obliged to sanctify Sunday and to abstain on that day from unnecessary servile work? Is not the observance of this law among the most prominent of our sacred duties? But you may read the Bible from Genesis to Revelation, and you will not find a single line authorizing the sanctification of Sunday. The Scriptures enforce the religious observance of Saturday, a day which we never sanctify.
— Faith of Our Fathers, Cardinal Gibbons, p. 72
—Sabbath in Christianity - Wikipedia
In fact, the Catholic church takes pride in having moved it, using it to prove that, despite claiming sola scriptura, Protestant churches actually accept the authority of Rome.
"Question: Have you any other way of proving that the Church has power to institute festivals of precept?
"Answer: Had she not such power, she could not have done that in which all modern religionists agree with her — she could not have substituted the observance of Sunday, the first day of the week, for the observance of Saturday, the seventh day, a change for which there is no Scriptural authority."
— Stephen Keenan, A Doctrinal Catechism 3rd ed., p. 174.
"Question: Which is the Sabbath day?
"Answer: Saturday is the Sabbath day.
"Question: Why do we observe Sunday instead of Saturday?
"Answer. We observe Sunday instead of Saturday because the Catholic Church transferred the solemnity from Saturday to Sunday."
— Peter Geiermann, C.S.S.R., The Converts Catechism of Catholic Doctrine (1957), p. 50.
History records that the day of rest was established as Sunday during the 2nd and 3rd centuries:
The 2nd and 3rd centuries solidified the early church's emphasis upon Sunday worship and its rejection of a Jewish (Mosaic Law-based) observation of the Sabbath and manner of rest. Christian practice of following Sabbath after the manner of the Hebrews declined, prompting Tertullian to note "to [us] Sabbaths are strange" and unobserved. Even as late as the 4th century, Judaizing was still sometimes a problem within the Church, but by this time it was repudiated strongly as heresy.
Sunday was another work day in the Roman Empire. On March 7, 321, however, Roman Emperor Constantine I issued a civil decree making Sunday a day of rest from labor, stating:
All judges and city people and the craftsmen shall rest upon the venerable day of the sun. Country people, however, may freely attend to the cultivation of the fields, because it frequently happens that no other days are better adapted for planting the grain in the furrows or the vines in trenches. So that the advantage given by heavenly providence may not for the occasion of a short time perish.
— Sabbath in Christianity - Wikipedia
A very long list of quotations on this topic can be found in Roman Catholic and Protestant Confessions About Sunday