Low-cost operator Flybe is to end four flights from Norwich International Airport, claiming a levy being applied on passengers makes its flights too expensive.