income decreased in the linked quarter, as we recognized a $1.3 million valuation allowance on mortgage servicing rights as a result of changes in the interest rate environment and prepayment speeds. Income related to Wealth Management increased in the second quarter of 2021, when compared to the first quarter of 2021 and the second quarter of 2020, due primarily to higher levels of fees earned on AUM. Loan and servicing fees in the second quarter of 2021 increased compared to the second quarter of 2020 due to higher loan volume.
Noninterest Expense
Noninterest expense increased 3.2% to $35.6 million for the second quarter of 2021, compared to $34.5 million for the first quarter of 2021, and increased 15.1%, compared to $30.9 million for the second quarter of 2020. Compensation and benefits were $20.2 million in the second quarter of 2021, a $1.3 million decrease compared to $21.5 million in the first quarter of 2021, due to merit increases, annual bonus, and commission payouts in the first quarter. Noninterest expenses for Wealth Management decreased by $0.3 million in the linked quarter also due to lower compensation and benefits costs. In addition, noninterest expense included $1.2 million of one-time merger expenses during the quarter related to the TGR Financial acquisition.
Our efficiency ratio for the second quarter of 2021 was 47.3%, compared to 51.5% for the first quarter of 2021 and 53.0% in the second quarter of 2020.
Income Tax Expense
We recorded an income tax expense of $10.2 million in the second quarter of 2021, compared to an income tax expense of $8.9 million in the first quarter of 2021, and an income tax expense of $7.3 million in the second quarter of 2020. Our effective tax rate for the second quarter of 2021 was 28.2%, compared to 28.5% for the first quarter of 2021, and 28.9% for the second quarter of 2020.
Asset Quality
Total nonperforming assets were $16.2 million as of June 30, 2021, compared to $16.6 million as of March 31, 2021, and $15.5 million as of June 30, 2020. Our ratio of nonperforming assets to total assets was 0.20% as of June 30, 2021, compared to 0.24% as of March 31, 2021, and 0.22% as of June 30, 2020. Total delinquent loans decreased $7.8 million, to $2.6 million as of June 30, 2021, compared to $10.4 million as of March 31, 2021.
Our allowance for credit losses for loans was $22.3 million, or 0.40% of total loans, as of June 30, 2021, compared to $23.2 million, or 0.45%, as of March 31, 2021 and $28.1 million, or 0.55%, as of June 30, 2020. The linked quarter decrease in the allowance for credit losses for loans was a result of improvement in the economic scenario outlook. Net charge-offs during the second quarter of 2021 were $0.1 million, or 0.01% of average loans annualized, compared to net recoveries of $0.2 million, or (0.01)% of average loans annualized, for the first quarter of 2021, and $0.4 million, or 0.03% of average loans annualized, for the second quarter of 2020.
The ratio of the allowance for credit losses for loans to total nonperforming assets was 137.6% as of June 30, 2021, compared to 139.3% as of March 31, 2021 and 181.3% as of June 30, 2020.