From the looks of it, the most of the issues with framerate originate from loading new zones. Depending on the engine you're using there may be systems in place for dealing with that. Coffee Stain studios managed to dramatically increase loading performances by switching to a system made for that within the Unreal Engine.