No you don't need to remove the cover with red arrow.
Looks like you got it.
Take rubber or better yet hard plastic mallet and whack from different sides. There are at least 2 pins that float between the case and engine.
Your trying to just break seal of gasket. Once you see a crack between case you can work it off.