Just back to confirm that unplugging excess USB devices didn't work. Nothing in the way there.
I'm going to try to hunt around the internet and see what else could be causing this DirectX11 error...
EDIT: Ok the weirdest thing happened. I downloaded something called the BF4 Settings Editor from this page: http://battlefield.realmware.co.uk/bf4-settings-editor/downloads
I loaded their default profile from the Profiles tab, and then under the Settings tab, in Graphics I changed Display Mode to Windowed, and under Console I unclicked the check marks for DirectX11, DirectX11.1, DirectX11.1 Runtime, and DX Deferred CS Path.
I then saved those settings. I got an error saying it couldn't properly save PROF_SAVE_BODY or something like that.
I loaded BF4 from Origin, and hit Play Campaign. AND IT LOADED. I played for about 5 minutes and then quit out to test if multiplayer would load. It wouldn't load. It went right back to the APPCRASH d3d11.dll error I have been getting forever. When I tried to load Campaign again, it also gave me the same old error. I tried re-saving the settings in BF4 Settings Editor, but no luck. I then went into My Documents/Battlefield 4/Profiles and deleted everything in the folder and re-created the new profile. Still wouldn't load.
So I have it nailed down the problem seems to be something with either the game running in Fullscreen mode or with DirectX 11 on my computer. Is there a way to force these settings to OFF through the Origin command console?