Mr. Simard concluded, “As we move into the second half of the year, we are encouraged by an improving economic outlook and better operating conditions. Our collective resilience has prepared and positioned us to move forward with the same resolve that has sustained us throughout the pandemic. We have a unique complementary footprint that is enabling us to utilize all earnings levers that align with our model and strategy. We look forward to continuing to serve our customers and communities in the way they are accustomed to.”
DIVIDEND DECLARED
The Board of Directors voted to declare a cash dividend of $0.24 per share to shareholders of record at the close of business on August 17, 2021, payable on September 17, 2021. This dividend equates to a 3.35% annualized yield based on the $28.62 closing price of the Company's common stock at the end of the second quarter of 2021.
FINANCIAL CONDITION
Total assets were $3.6 billion at the end of the second quarter as the Company leveraged excess cash liquidity to reduce maturing brokered deposits of $104.7 million during the quarter. Loans decreased $35.5 million during the quarter, or 6% on an annualized basis, primarily due to PPP loan forgiveness and prepayments on residential loans.
During the quarter we developed 76 new commercial relationships, resulting in commercial real estate loan growth of 6% on an annualized basis and commercial and industrial loan growth 13% on an annualized basis, exclusive of PPP loans. PPP loan balances totaled $65.9 million at quarter-end, consisting of $62.7 million of 2021 originations and $3.2 million from 2020. Unearned deferred fee balances on PPP loans totaled $3.7 million at the end of the quarter. These balances are expected to be realized through early 2022. COVID loan modifications totaled $19.0 million, down from $43.0 million at the end of the first quarter 2021, as 97% of modified loans have resumed normal payment schedules. Total residential loans decreased $47.5 million, which includes $84.0 million of originations, $56.0 million of sales in the secondary market and $75.5 million of prepayments/amortization. Total originations during the quarter included $51.0 million that was sold on the secondary market and $33.0 million that was recorded on the balance sheet.
The allowance for credit losses decreased to $22.8 million during the second quarter due to stronger economic forecasts, offset by changes in overall loan mix. Net charge offs totaled $73 thousand, or less than 0.01% of the total loan portfolio, and non-accruing loans decreased to $13.6 million, or 0.54% of the total loans. The ratio of past due loans to total loans improved to 0.15% of total loans at June 30, 2021, decreasing from 0.44% in the first quarter of 2021. Commercial past due loans totaled $1.9 million at quarter end, which is the lowest level since 2016 when the portfolio was approximately 36% of its current size.
Total deposits decreased $90.0 million to $2.8 billion during the quarter, due to lower time deposits, offset by significant growth in core deposits. Core deposits increased $77.8 million, or 14% on an annualized basis, during the quarter. Over 1,000 new customer relationships were added in the quarter. Time deposits decreased $167.7 million during the quarter, primarily due to $104.7 million of brokered deposits not being replaced upon maturity due to excess liquidity. Retail time deposits decreased $63.0 million as customers moved funds to transactional accounts upon contractual maturity.
The Company’s book value per share was $27.76 at June 30, 2021, compared with $27.13 at the end of the first quarter 2021. Tangible book value per share (non-GAAP measure) was $19.30 at the end of the second quarter 2021, compared to $18.64 at the end of the first quarter 2021, equating to an annualized growth rate of 14%. Other comprehensive income included unrealized gains on securities totaling $7.2 million in the second quarter 2021 compared to $4.5 million at the end of the first quarter 2021.
RESULTS OF OPERATIONS
Net income in the second quarter 2021 was $9.0 million, or $0.60 per share, compared to $8.5 million, or $0.55 per share, in the same quarter of 2020. Net income benefited from higher fee income and a credit provision recapture in the quarter. Core earnings totaled $9.4 million or $0.63 per share, compared to $8.6 million, or $0.56 per share, in the same quarter of 2020. Non-core items (non-GAAP) reduced net income by $384 thousand and $119 thousand in second quarters of 2021 and 2020, respectively.
Net interest margin equaled 2.74% compared to 2.93% in the same period of 2020. PPP loans contributed 7 basis points to NIM during the quarter as the majority of the remaining 2020 originations were forgiven. Accretion on PPP loans originated in 2021 are not expected to materially affect NIM until loans are forgiven starting in the third quarter 2021. Interest-bearing cash balances, held mostly at the Federal Reserve Bank, reduced NIM by 19 basis points. The yield on earning assets totaled 3.26% compared to 3.73% in the second quarter 2020. Excluding the impact of PPP and excess cash, the yield on earning assets totaled 3.44% and 3.98% for the same periods. Costs of funds decreased to 0.66% from 0.96% in the second quarter 2020 due to lower deposit rates and reductions to wholesale funding afforded by significant growth in core deposits. Brokered deposits that matured during second quarter carried 9 basis points of the total funding cost.