Because they are out to make a quick buck by chasing trends
it is to a degree EAs Marketing i think, they most likely have too much sway in how far certain concepts get evolved and which get dropped.
2042 is a prime example.
they marketed the game with a lot of BF nostalgia, but its all more or less superficial, they have portal as a loveletter to fans yet it lacks any feature to make it stick (i.E persistent rentable servers for communities to bother). the gameplay loop is uninspired for the most part and the maps lack any real WOW factor ( i do not count the tornado because that is also only a buzz word then it has impact on the map/game). BFV was hated because DICE delivered a broken mess of a game and handled the PR in a * poor state. Statements like "right side of history" or " don't like it, don't buy it" got so intertwined with the product they were rarely not spoken in the same sentence. a different example of how not to PR is calling the fanbase "uneducated" but then again i purely hated BFV for the * poor technical performance and all the TTD/TTK issues the game had and to a small extend still has...
now with 2042 as far as i can tell DICE wanted to distance themselves as much as humanly possible from BFV, what they didn't realize by doing so they reinvented BF without parts of its core. not everything is gone but enough to ask if this is not another spin off like BF:Hardline was....
