Games not going fullscreen on OBS

I'm having trouble trying to get my games running full screen when I'm live streaming. To sum it up to make it easy to explain. Games that aren't at 1920X1080, but are at a lower resolution, does not go full screen, but only shows up as a window. I don't know what is going on there. If anyone can help, that will be awesome!