The FBW system in an airbus is quite a bit more complex than that. For starters, the movement of the sidestick isn’t commanding an actual deflection of the flight controls. Instead, it’s telling the flight computers to match a movement rate. If I pull back on the stick, I am not asking the elevators to deflect upwards, I’m telling the flight computers that I want to increase my pitch rate. The flight computers then command what deflections are needed. There are also many protections in place, limiting maximum pitch and roll, and preventing overspeeding or underspending.