Of course after hours I finally give in and post here and then resolve the issue myself.
I went into the text editor, and I just put a <!–more–> at where I wanted the excerpt to end. This resolved the issue.
Maybe this will help someone else in the future 🙂