No, you are wrong. Jewish Sunday begins at sunset on Saturday. The angels came and moved the stone away in the night.

Please consider this writing from the apocryphal Gospel of Peter describing the opening of the tomb: http://www.earlychristianwritings.com/text/gospelpeter-brown.html

 [25] Then the Jews and the elders and the priests, having come to know how much wrong they had done themselves, began to beat themselves and say: 'Woe to our sins. The judgment has approached and the end of Jerusalem.' [26] But I with the companions was sorrowful; and having been wounded in spirit, we were in hiding, for we were sought after by them as wrongdoers and as wishing to set fire to the sanctuary. [27] In addition to all these things we were fasting; and we were sitting mourning and weeping night and day until the Sabbath.

[28] But the scribes and Pharisees and elders, having gathered together with one another, having heard that all the people were murmuring and beating their breasts, saying that 'If at his death these very great signs happened, behold how just he was,' [29] feared (especially the elders) and came before Pilate, begging him and saying, [30] 'Give over soldiers to us in order that we may safeguard his burial place for three days, lest, having come, his disciples steal him, and the people accept that he is risen from the death, and they do us wrong.' [31] But Pilate gave over to them Petronius the centurion with soldiers to safeguard the sepulcher. And with these the elders and scribes came to the burial place. [32] And having rolled a large stone, all who were there, together with the centurion and the soldiers, placed it against the door of the burial place. [33] And they marked it with seven wax seals; and having pitched a tent there, they safeguarded it. [34] But early when the Sabbath was dawning, a crowd came from Jerusalem and the surrounding area in order that they might see the sealed tomb.

[35] But in the night in which the Lord's day dawned, when the soldiers were safeguarding it two by two in every watch, there was a loud voice in heaven; [36] and they saw that the heavens were opened and that two males who had much radiance had come down from there and come near the sepulcher. [37] But that stone which had been thrust against the door, having rolled by itself, went a distance off the side; and the sepulcher opened, and both the young men entered. [38] And so those soldiers, having seen, awakened the centurion and the elders (for they too were present, safeguarding). [39] And while they were relating what they had seen, again they see three males who have come out from they sepulcher, with the two supporting the other one, and a cross following them, [40] and the head of the two reaching unto heaven, but that of the one being led out by a hand by them going beyond the heavens. [41] And they were hearing a voice from the heavens saying, 'Have you made proclamation to the fallen-asleep?' [42] And an obeisance was heard from the cross, 'Yes.' [43]

And so those people were seeking a common perspective to go off and make these things clear to Pilate; [44] and while they were still considering it through, there appear again the opened heavens and a certain man having come down and entered into the burial place. [45] Having seen these things, those around the centurion hastened at night before Pilate (having left the sepulcher which they were safeguarding) and described all the things that they indeed had seen, agonizing greatly and saying: 'Truly he was God's Son.'

It describes two angels bringing Jesus out from the sepulcher "in the night in which the Lord's day dawned" (which is Sunday)