The credit card business used to be much more profitable for banks; a recent study showed that fee income across the industry fell 10% between 2017 and 2018; the study noted that while swipe fees and annual fee income has been rising they have been offset by other fee income such as late fees; American Banker shares some of the likely contributing factors such as the CARD Act and low unemployment. Source
