quarter two non-performing loans that were included in the recreation sector in previous quarters, with a recorded investment of $10.9 million, were sold and a charge off of $937,000 was recorded.
We provided access to the Paycheck Protection Program to both our existing customers and new customers, to ensure small businesses in our communities have access to this important lifeline for their businesses. As of December 31, 2020, Paycheck Protection Program loans amounted to $126.5 million. As of December 31, 2020, there was $2.7 million in deferred processing fee income that will be recognized over the life of the loans.
We are also working with commercial loan customers that may need payment deferrals or other accommodations to keep their loans out of default through the COVID-19 pandemic. As of December 31, 2020, we have provided 171 payment deferrals on commercial loans with a total principal balance of $295.3 million, or 14.0%, of total commercial loans, of which $222.2 million are loans included in an at risk sector. As of December 31, 2020, 90.8% of the commercial deferrals have expired and the borrower is making payments as agreed, 0.09% of the commercial deferrals have expired and the borrower is delinquent, and 9.1% are in active deferral period. The active commercial deferrals expire during 2021. We have also provided $4.6 million loans with other accommodations. We continue to consider requests for additional deferrals or new deferrals at December 31, 2020 for commercial credits.
The residential loan and consumer loan portfolios have not experienced significant credit quality deterioration as of December 31, 2020; however, the continuing impact and uncertain nature of the COVID-19 pandemic may result in increases in delinquencies, charge offs and loan modifications in these portfolios through the remainder of 2021. As of December 31, 2020, we had provided 172 payment deferrals on residential mortgage loans with a total principal balance of $51.9 million, or 4.7% of total residential loans, of which 86.1% of the deferrals have expired and are paying as agreed and 5.4% are in active deferral periods. We had 495 payment deferrals on consumer loans with a total principal balance of $11.6 million, or 4.2%, of total consumer loans, of which 93.5% of the deferrals have expired and are paying as agreed. Requests for additional extensions on residential mortgage loans and consumer loans were not significant as of December 31, 2020.
Net charge offs totaled $1.4 million for the quarter ended December 31, 2020, or 0.16% of average loans outstanding on an annualized basis, compared to $338,000, or 0.04% of average loans outstanding on an annualized basis, for the quarter ended September 30, 2020 and $235,000, or 0.03% of average loans outstanding on an annualized basis, for the quarter ended December 31, 2019. Net charge offs for the quarter ended December 31, 2020 include a charge off in the amount of $937,000 recorded on the sale of two nonperforming commercial loans.
Total nonperforming assets were $34.7 million at December 31, 2020, compared to $41.0 million at September 30, 2020 and $31.0 million at December 31, 2019. Nonperforming assets as a percentage of total assets were 0.77% at December 31, 2020, 0.93% at September 30, 2020, and 0.76% at December 31, 2019. The decrease from the preceding quarter is primarily due to the two commercial loans noted above that were sold and amounted to $10.9 million.
Balance Sheet
Total assets increased $55.3 million, or 1.2%, to $4.48 billion at December 31, 2020 from $4.43 billion at September 30, 2020. The increase primarily reflects an increase of $65.8 million in short-term investments and an $18.2 million increase in loans held for sale, partially offset by a $27.4 million decrease in net loans.
Net loans decreased $27.4 million, or 0.08%, to $3.44 billion at December 31, 2020 from $3.47 billion at September 30, 2020. The net decrease in loans for the three months ended December 31, 2020 was primarily due to decreases in commercial construction loans of $112.6 million, commercial and industrial loans of $15.7 million, consumer loans of $38.9 million and residential real estate loans of $25.1 million, partially offset by an increase in commercial real estate loans of $171.2 million. The changes in commercial real estate loans and commercial construction loans reflect $79.2 million of commercial construction loans that converted to commercial real estate loans at the end of the construction phase. Additionally, two non-performing commercial construction loans with a net book value of $10.9 million were sold at a loss of $937,000. The allowance for loan losses increased $6.2 million, or 12.5% to $55.4 million at December 31, 2020 from $49.2 million at September 30, 2020 as provisions continue to be made in response to portfolio risks as a result of COVID-19 pandemic.
Total deposits increased $140.3 million, or 4.2%, to $3.51 billion at December 31, 2020 from $3.37 billion at September 30, 2020. Compared to the prior quarter, non-certificate accounts increased $193.9 million and term certificate accounts decreased $53.6 million. FHLB borrowings decreased $87.0 million, or 36.9%, to $149.1 million at December 31, 2020 from $236.1 million at September 30, 2020.
Total stockholders’ equity was $696.3 million at December 31, 2020, compared to $694.1 million at September 30, 2020 and $665.8 million at December 31, 2019. The Company adopted a share repurchase program on September 3, 2020 to repurchase up to approximately 5% of the Company’s outstanding shares and repurchased 1,533,500 shares in the fourth quarter of 2020 recorded in treasury stock on the balance sheet. The tangible common equity to tangible assets ratio was 14.11% at December 31, 2020, 14.23% at