Inflation is often said to be a tax on the poor, but this time it seems to have hit middle-income households the hardest.