Sterling Bancorp, Inc. (SBT) 10-Q 9 Nov 20 2020 Q3 Quarterly report Financial data

Document and Entity Information

Document and Entity Information - shares	9 Months Ended
	Sep. 30, 2020	Nov. 03, 2020
Document and Entity Information
Document Type	10-Q
Document Quarterly Report	true
Document Period End Date	Sep. 30, 2020
Document Transition Report	false
Entity File Number	001-38290
Entity Registrant Name	Sterling Bancorp, Inc.
Entity Incorporation, State or Country Code	MI
Entity Tax Identification Number	38-3163775
Entity Address, Address Line One	One Towne Square
Entity Address, Address Line Two	Suite 1900
Entity Address, City or Town	Southfield
Entity Address, State or Province	MI
Entity Address, Postal Zip Code	48076
City Area Code	(248)
Local Phone Number	355-2400
Title of 12(b) Security	Common stock
Trading Symbol	SBT
Security Exchange Name	NASDAQ
Entity Current Reporting Status	Yes
Entity Interactive Data Current	Yes
Entity Filer Category	Accelerated Filer
Entity Small Business	true
Entity Emerging Growth Company	true
Entity Ex Transition Period	true
Entity Shell Company	false
Entity Common Stock, Shares Outstanding		49,973,861
Entity Central Index Key	0001680379
Current Fiscal Year End Date	--12-31
Document Fiscal Year Focus	2020
Document Fiscal Period Focus	Q3
Amendment Flag	false

Condensed Consolidated Balance

Condensed Consolidated Balance Sheets - USD ($) $ in Thousands	Sep. 30, 2020	Dec. 31, 2019
Assets
Cash and due from banks	$ 917,996	$ 77,819
Interest-bearing time deposits with other banks	7,988	1,025
Investment securities	247,884	152,544
Mortgage loans held for sale	3,643	1,337
Loans, net of allowance for loan losses of $48,258 and $21,730	2,627,324	2,891,530
Accrued interest receivable	12,385	13,718
Mortgage servicing rights, net	6,423	9,765
Leasehold improvements and equipment, net	8,493	9,198
Operating lease right-of-use assets	19,253	18,715
Federal Home Loan Bank stock, at cost	22,950	22,950
Cash surrender value of bank-owned life insurance	32,355	31,917
Deferred tax asset, net	20,589	12,095
Other assets	9,322	2,271
Total assets	3,936,605	3,244,884
Liabilities:
Noninterest-bearing deposits	66,316	77,563
Interest-bearing deposits	3,028,854	2,417,877
Total deposits	3,095,170	2,495,440
Federal Home Loan Bank borrowings	318,000	229,000
Subordinated notes, net	65,300	65,179
Operating lease liabilities	20,514	19,868
Accrued expenses and other liabilities	106,477	102,783
Total liabilities	3,605,461	2,912,270
Shareholders' equity:
Additional paid-in capital	13,386	13,210
Retained earnings	236,546	238,319
Accumulated other comprehensive income	405	196
Total shareholders' equity	331,144	332,614
Total liabilities and shareholders' equity	3,936,605	3,244,884
Common stock
Shareholders' equity:
Common stock, no par value, authorized 500,000,000 shares; issued and outstanding 49,977,209 shares at September 30, 2020 and 49,944,473 shares at December 31, 2019, respectively	80,807	80,889
Total shareholders' equity	$ 80,807	$ 80,889

Condensed Consolidated Balanc_2

Condensed Consolidated Balance Sheets (Parenthetical) - USD ($) $ in Thousands	Sep. 30, 2020	Dec. 31, 2019
Allowance for loan losses	$ 48,258	$ 21,730
Preferred stock, authorized (in shares)	10,000,000	10,000,000
Preferred stock, issued (in shares)	0	0
Preferred stock, outstanding (in shares)	0	0
Common stock
Common stock, par value (in dollars per share)	$ 0	$ 0
Common stock, authorized (in shares)	500,000,000	500,000,000
Common stock, issued (in shares)	49,977,209	49,944,473
Common stock, outstanding (in shares)	49,977,209	49,944,473

Condensed Consolidated Statemen

Condensed Consolidated Statements of Income - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2020	Sep. 30, 2019	Sep. 30, 2020	Sep. 30, 2019
Interest income
Interest and fees on loans	$ 35,918	$ 42,351	$ 112,944	$ 127,374
Interest and dividends on investment securities and restricted stock	901	1,252	2,972	3,751
Other interest	211	608	786	1,060
Total interest income	37,030	44,211	116,702	132,185
Interest expense
Interest on deposits	9,288	12,249	29,228	34,429
Interest on Federal Home Loan Bank borrowings	859	777	2,546	3,207
Interest on subordinated notes	1,178	1,175	3,533	3,524
Total interest expense	11,325	14,201	35,307	41,160
Net interest income	25,705	30,010	81,395	91,025
Provision (recovery) for loan losses	2,123	251	27,273	(583)
Net interest income after provision (recovery) for loan losses	23,582	29,759	54,122	91,608
Non-interest income
Gain (loss) on sale of investment securities	(20)		179
Gain on sale of mortgage loans held for sale	437	194	1,457	374
Gain on sale of portfolio loans		1,683		5,985
Unrealized gains on equity securities		30	123	136
Net servicing income (loss)	(121)	240	(1,239)	(437)
Income on cash surrender value of bank-owned life insurance	317	324	962	949
Other	127	106	330	485
Total non-interest income	1,111	3,165	2,963	9,061
Non-interest expense
Salaries and employee benefits	7,517	7,545	21,606	22,193
Occupancy and equipment	2,219	2,126	6,545	6,533
Professional fees	12,207	1,389	23,787	3,455
Advertising and marketing	71	269	414	1,114
FDIC assessments	956	(5)	1,215	440
Data processing	392	271	1,078	882
Other	1,612	1,831	4,611	5,656
Total non-interest expense	24,974	13,426	59,256	40,273
Income (loss) before income taxes	(281)	19,498	(2,171)	60,396
Income tax expense (benefit)	(170)	5,614	(897)	17,395
Net income (loss)	$ (111)	$ 13,884	$ (1,274)	$ 43,001
Income (loss) per share:
Basic	$ 0	$ 0.28	$ (0.03)	$ 0.84
Diluted	$ 0	$ 0.28	$ (0.03)	$ 0.83
Weighted average common shares outstanding:
Basic	49,843,925	50,428,108	49,839,860	51,490,046
Diluted	49,843,925	50,441,572	49,839,860	51,500,657
Service charges and fees
Non-interest income
Non-interest income	$ 61	$ 111	$ 273	$ 327
Investment management and advisory fees
Non-interest income
Non-interest income	$ 310	$ 477	$ 878	$ 1,242

Condensed Consolidated Statem_2

Condensed Consolidated Statements of Comprehensive Income - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2020	Sep. 30, 2019	Sep. 30, 2020	Sep. 30, 2019
Condensed Consolidated Statements of Comprehensive Income
Net income (loss)	$ (111)	$ 13,884	$ (1,274)	$ 43,001
Other comprehensive income (loss), net of tax:
Unrealized gains (losses) on investment securities, arising during the period, net of tax effect of $(86), $(14), $131, and $63, respectively	(222)	(35)	338	162
Reclassification adjustment for (gains) losses included in net income of $20, $-, $(179), and $-, respectively, included in gain (loss) on sale of investment securities, net of tax effect of $(6), $-, $50, and $-, respectively	14		(129)
Total other comprehensive income (loss)	(208)	(35)	209	162
Comprehensive income (loss)	$ (319)	$ 13,849	$ (1,065)	$ 43,163

Condensed Consolidated Statem_3

Condensed Consolidated Statements of Comprehensive Income (Parenthetical) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2020	Sep. 30, 2019	Sep. 30, 2020	Sep. 30, 2019
Condensed Consolidated Statements of Comprehensive Income
Unrealized gains (losses) on investment securities, arising during the period, tax effect	$ (86)	$ (14)	$ 131	$ 63
Reclassification adjustment for gains (losses) included in net income on sale of investment securities, before tax	20		(179)
Reclassification adjustment for gains (losses) included in net income on sale of investment securities, tax effect	$ (6)		$ 50

Condensed Consolidated Statem_4

Condensed Consolidated Statements of Changes in Shareholders' Equity - USD ($) $ in Thousands	Common stock	Additional Paid-in Capital	Retained Earnings	Accumulated Other Comprehensive Income (Loss)	Total
Balance at beginning of the period at Dec. 31, 2018	$ 111,238	$ 12,713	$ 211,115	$ (9)	$ 335,057
Balance at beginning of the period (in shares) at Dec. 31, 2018	53,012,283
Increase (Decrease) in Stockholders' Equity
Net income (loss)			15,683		15,683
Repurchases of shares of common stock (Note 10)	$ (11,544)				(11,544)
Repurchases of shares of common stock (Note 10) (in shares)	(1,212,574)
Stock-based compensation		126			126
Stock-based compensation (in shares)	71,144
Other comprehensive income (loss)				106	106
Dividends distributed			(526)		(526)
Balance at end of the period at Mar. 31, 2019	$ 99,694	12,839	226,272	97	338,902
Balance at end of the period (in shares) at Mar. 31, 2019	51,870,853
Balance at beginning of the period at Dec. 31, 2018	$ 111,238	12,713	211,115	(9)	335,057
Balance at beginning of the period (in shares) at Dec. 31, 2018	53,012,283
Increase (Decrease) in Stockholders' Equity
Net income (loss)					43,001
Other comprehensive income (loss)					162
Balance at end of the period at Sep. 30, 2019	$ 85,515	13,138	252,571	153	351,377
Balance at end of the period (in shares) at Sep. 30, 2019	50,424,940
Balance at beginning of the period at Mar. 31, 2019	$ 99,694	12,839	226,272	97	338,902
Balance at beginning of the period (in shares) at Mar. 31, 2019	51,870,853
Increase (Decrease) in Stockholders' Equity
Net income (loss)			13,434		13,434
Repurchases of shares of common stock (Note 10)	$ (10,011)				(10,011)
Repurchases of shares of common stock (Note 10) (in shares)	(1,034,792)
Stock-based compensation		153			153
Stock-based compensation (in shares)	10,460
Other comprehensive income (loss)				91	91
Dividends distributed			(516)		(516)
Balance at end of the period at Jun. 30, 2019	$ 89,683	12,992	239,190	188	342,053
Balance at end of the period (in shares) at Jun. 30, 2019	50,846,521
Increase (Decrease) in Stockholders' Equity
Net income (loss)			13,884		13,884
Repurchases of shares of common stock (Note 10)	$ (4,168)				(4,168)
Repurchases of shares of common stock (Note 10) (in shares)	(421,581)
Stock-based compensation		146			146
Other comprehensive income (loss)				(35)	(35)
Dividends distributed			(503)		(503)
Balance at end of the period at Sep. 30, 2019	$ 85,515	13,138	252,571	153	351,377
Balance at end of the period (in shares) at Sep. 30, 2019	50,424,940
Balance at beginning of the period at Dec. 31, 2019	$ 80,889	13,210	238,319	196	332,614
Balance at beginning of the period (in shares) at Dec. 31, 2019	49,944,473
Increase (Decrease) in Stockholders' Equity
Net income (loss)			(4,030)		(4,030)
Repurchases of shares of common stock (Note 10)	$ (82)				(82)
Repurchases of shares of common stock (Note 10) (in shares)	(10,912)
Stock-based compensation		109			109
Stock-based compensation (in shares)	134,177
Other comprehensive income (loss)				563	563
Dividends distributed			(499)		(499)
Balance at end of the period at Mar. 31, 2020	$ 80,807	13,319	233,790	759	328,675
Balance at end of the period (in shares) at Mar. 31, 2020	50,067,738
Balance at beginning of the period at Dec. 31, 2019	$ 80,889	13,210	238,319	196	332,614
Balance at beginning of the period (in shares) at Dec. 31, 2019	49,944,473
Increase (Decrease) in Stockholders' Equity
Net income (loss)					(1,274)
Repurchases of shares of common stock (Note 10)	$ (82)
Repurchases of shares of common stock (Note 10) (in shares)	(10,912)
Other comprehensive income (loss)					209
Balance at end of the period at Sep. 30, 2020	$ 80,807	13,386	236,546	405	331,144
Balance at end of the period (in shares) at Sep. 30, 2020	49,977,209
Balance at beginning of the period at Mar. 31, 2020	$ 80,807	13,319	233,790	759	328,675
Balance at beginning of the period (in shares) at Mar. 31, 2020	50,067,738
Increase (Decrease) in Stockholders' Equity
Net income (loss)			2,867		2,867
Stock-based compensation		9			9
Stock-based compensation (in shares)	(60,323)
Other comprehensive income (loss)				(146)	(146)
Balance at end of the period at Jun. 30, 2020	$ 80,807	13,328	236,657	613	331,405
Balance at end of the period (in shares) at Jun. 30, 2020	50,007,415
Increase (Decrease) in Stockholders' Equity
Net income (loss)			(111)		(111)
Stock-based compensation		58			58
Stock-based compensation (in shares)	(30,206)
Other comprehensive income (loss)				(208)	(208)
Balance at end of the period at Sep. 30, 2020	$ 80,807	$ 13,386	$ 236,546	$ 405	$ 331,144
Balance at end of the period (in shares) at Sep. 30, 2020	49,977,209

Condensed Consolidated Statem_5

Condensed Consolidated Statements of Changes in Shareholders' Equity (Parenthetical) - $ / shares	3 Months Ended
	Mar. 31, 2020	Sep. 30, 2019	Jun. 30, 2019	Mar. 31, 2019
Condensed Consolidated Statements of Changes in Shareholders' Equity
Dividends paid per common share (in dollars per share)	$ 0.01	$ 0.01	$ 0.01	$ 0.01

Condensed Consolidated Statem_6

Condensed Consolidated Statements of Cash Flows - USD ($) $ in Thousands	9 Months Ended
	Sep. 30, 2020	Sep. 30, 2019
Cash Flows From Operating Activities
Net income (loss)	$ (1,274)	$ 43,001
Adjustments to reconcile net income to net cash provided by operating activities:
Provision (recovery) for loan losses	27,273	(583)
Deferred income taxes	(8,574)	(622)
Gain on sale of investment securities	(179)
Unrealized gains on equity securities	(123)	(136)
Amortization (accretion), net, on investment securities	128	(1,273)
Depreciation and amortization on leasehold improvements and equipment	1,199	1,210
Amortization of intangible asset		338
Origination, premium paid and purchase of loans, net of principal payments, mortgage loans held for sale	(160,540)	(42,026)
Proceeds from sale of mortgage loans held for sale	158,683	42,375
Gain on sale of mortgage loans held for sale	(1,457)	(374)
Gain on sale of portfolio loans		(5,985)
Increase in cash surrender value of bank-owned life insurance, net of premiums	(438)	(459)
Valuation allowance adjustments and amortization of mortgage servicing rights	3,951	3,488
Stock-based compensation	176	425
Other	121	124
Change in operating assets and liabilities:
Accrued interest receivable	1,333	(332)
Other assets	(3,937)	4,170
Accrued expenses and other liabilities	855	30,443
Net cash provided by (used in) operating activities	17,197	73,784
Cash Flows From Investing Activities
Maturities of interest-bearing time deposits with other banks	1,743
Purchases of interest-bearing time deposits with other banks	(8,706)
Maturities and principal receipts of investment securities	117,533	114,433
Sales of investment securities	99,971
Purchases of investment securities	(312,381)	(117,209)
Net decrease (increase) in loans	306,630	(177,470)
Purchases of portfolio loans	(69,465)
Proceeds from the sale of portfolio loans		173,397
Purchase of leasehold improvements and equipment	(494)	(1,107)
Net cash provided by (used in) investing activities	134,831	(7,956)
Cash Flows From Financing Activities
Net increase in deposits	599,730	119,160
Proceeds from advances from Federal Home Loan Bank	100,000	2,461,000
Repayments of advances from Federal Home Loan Bank	(11,000)	(2,525,000)
Repurchases of shares of common stock	(82)	(25,723)
Dividends paid to shareholders	(499)	(1,545)
Net cash provided by financing activities	688,149	27,892
Net change in cash and due from banks	840,177	93,720
Cash and due from banks at beginning of period	77,819	52,526
Cash and due from banks at end of period	917,996	146,246
Cash paid:
Interest	39,837	29,667
Income taxes	13,897	15,946
Noncash investing and financing activities:
Transfers of residential real estate loans to mortgage loans held for sale		169,844
Transfers of residential real estate loans from mortgage loans held for sale	399	103
Right-of-use assets obtained in exchange for new operating lease liabilities	$ 3,449	$ 740

Nature of Operations and Basis

Nature of Operations and Basis of Presentation	9 Months Ended
	Sep. 30, 2020
Nature of Operations and Basis of Presentation
Nature of Operations and Basis of Presentation	Note 1—Nature of Operations and Basis of Presentation Nature of Operations Sterling Bancorp, Inc. (the “Company”) is a unitary thrift holding company that was incorporated in 1989 and the parent company of its wholly owned subsidiary, Sterling Bank and Trust, F.S.B. (the “Bank”). The Company’s business is conducted through the Bank, which was formed in 1984. The Bank originates residential and commercial real estate loans, construction loans, commercial lines of credit, and other consumer loans and provides deposit products, consisting primarily of checking, savings and term certificate accounts. The Bank operates through a network of 30 branches of which 26 branches are located in San Francisco and Los Angeles, California with the remaining branches located in New York, New York, Southfield, Michigan and the greater Seattle market. The Company is headquartered in Southfield, Michigan and its operations are in the financial services industry. Management evaluates the performance of its business based on one reportable segment, community banking. The Company is subject to regulation, examination and supervision by the Board of Governors of the Federal Reserve (“Federal Reserve”). The Bank is a federally chartered stock savings bank which is subject to regulation, supervision and examination by the Office of the Comptroller of the Currency (“OCC”) of the U.S. Department of Treasury and the Federal Deposit Insurance Corporation (“FDIC”) and is a member of the Federal Home Loan Bank (“FHLB”) system. Basis of Presentation The condensed consolidated balance sheet as of September 30, 2020, and the condensed consolidated statements of income, comprehensive income, changes in shareholders’ equity and cash flows for the three and nine months ended September 30, 2020 and 2019 are unaudited. The unaudited condensed consolidated financial statements have been prepared on the same basis as the annual consolidated financial statements and reflect all adjustments, in the opinion of management, of a normal recurring nature that are necessary for a fair presentation of the financial position, results of operations and cash flows for the periods presented. The financial data and other financial information disclosed in these notes to the condensed consolidated financial statements related to these periods are also unaudited. The results of operations for the three and nine months ended September 30, 2020 are not necessarily indicative of the results that may be expected for the year ended December 31, 2020 or for any future annual or interim period. The consolidated balance sheet at December 31, 2019 included herein was derived from the audited financial statements as of that date. The accompanying unaudited consolidated financial statements and notes thereto should be read in conjunction with the audited consolidated financial statements and related notes included in the Company’s Annual Report on Form 10-K for the year ended December 31, 2019.

New Accounting Standards

New Accounting Standards	9 Months Ended
	Sep. 30, 2020
New Accounting Standards
New Accounting Standards	Note 2—New Accounting Standards Recently Issued Accounting Guidance Not Yet Adopted In June 2016, the Financial Accounting Standards Board (“FASB”) issued ASU No. 2016-13, Financial Instruments—Credit Losses (Topic 326): Measurement of Credit Losses on Financial Instruments Codification Improvements to Topic 326, Financial Instruments—Credit Losses, Topic 815, Derivatives and Hedging, and Topic 825, Financial Instruments, Financial Instruments—Credit Losses (Topic 326): Targeted Transition Relief. Financial Instruments—Credit Losses (Topic 326), Derivatives and Hedging (Topic 815), and Leases (Topic 842): Effective Dates At this time, the Company has formed a cross-functional implementation team consisting of individuals from credit, finance and information systems. The implementation team has been working with a software vendor to assist in implementing required changes to credit loss estimation models and processes. The historical data set for model development has been finalized, and the credit loss estimation models are in the process of being developed and tested. The Company expects to recognize a cumulative effect adjustment to the opening balance of retained earnings as of the beginning of the first reporting period in which ASU No. 2016-13 is effective. The Company has not yet determined the magnitude of any such one-time adjustment or of the overall impact of ASU No. 2016-13 on its consolidated financial statements.

Summary of Significant Accounti

Summary of Significant Accounting Policies	9 Months Ended
	Sep. 30, 2020
Summary of Significant Accounting Policies
Summary of Significant Accounting Policies	Note 3—Summary of Significant Accounting Policies Principles of Consolidation The accompanying condensed consolidated financial statements have been prepared in conformity with accounting principles generally accepted in the United States of America (“U.S. GAAP”). The condensed consolidated financial statements include the results of the Company and its wholly-owned subsidiary. All significant intercompany accounts and transactions have been eliminated in consolidation. Use of Estimates The preparation of the condensed consolidated financial statements in conformity with U.S. GAAP requires management to make estimates and assumptions that affect the reported amounts of assets and liabilities and disclosure of contingent assets and liabilities at the date of the condensed consolidated financial statements and the reported amounts of revenues and expenses during the reporting period. Due to the inherent uncertainty involved in making estimates, actual results reported in the future periods may be based upon amounts that could differ from those estimates. During 2020, economies throughout the world have been severely disrupted because of the outbreak of the novel coronavirus (“COVID-19”). The Company’s primary market areas of California, the greater Seattle market, and New York became part of several epicenters of the COVID-19 pandemic. Banking and financial services have been designated essential businesses, and the Bank’s operations are continuing, subject to certain modifications to business practices imposed to safeguard the health and wellness of the Bank’s customers and employees, and to comply with applicable government directives. As of September 30, 2020, the impact of the outbreak of COVID-19 was continuing to unfold. As a result, many of management’s estimates and assumptions required increased judgement and carried a higher degree of variability and volatility. As events continue to evolve and additional information becomes available, management’s estimates may change materially in future periods. Concentration of Credit Risk The loan portfolio consists primarily of residential real estate loans which are collateralized by real estate. At September 30, 2020 and December 31, 2019, residential real estate loans accounted for 82% and 85%, respectively, of the loan portfolio. In addition, most of these residential loans and other commercial loans have been made to individuals and businesses in the state of California which are dependent on the area economy for their livelihoods and servicing of their loan obligation. At September 30, 2020 and December 31, 2019, approximately 87% and 89%, respectively, of the loan portfolio was originated in California. Starting December 9, 2019, the Bank suspended its Advantage Loan Program and announced that it permanently discontinued this program on March 6, 2020. This Program was a material component of the Bank’s total loan originations. Loans under the Advantage Loan Program totaled $1,633,714, or 75% of the residential loan portfolio, as of September 30, 2020, and $1,942,657, or 78% of the residential loan portfolio, as of December 31, 2019. ​

Investment Securities

Investment Securities	9 Months Ended
	Sep. 30, 2020
Investment Securities
Investment Securities	Note 4—Investment Securities Debt Securities The following tables summarize the amortized cost and fair value of debt securities available for sale at September 30, 2020 and December 31, 2019 and the corresponding amounts of gross unrealized gains and losses: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ September 30, 2020 ​ ​ Amortized ​ Gross Unrealized ​ Fair ​ Cost Gain Loss Value Available for sale: ​ ​ ​ ​ U.S. Treasury & Agency securities ​ $ 94,990 ​ $ 398 ​ $ (13) ​ $ 95,375 Mortgage-backed securities ​ ​ 26,650 ​ ​ 95 ​ ​ — ​ ​ 26,745 Collateralized mortgage obligations ​ 120,091 ​ 600 ​ (489) ​ 120,202 Collateralized debt obligations ​ 214 ​ — ​ (30) ​ 184 Total ​ $ 241,945 ​ $ 1,093 ​ $ (532) ​ $ 242,506 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ December 31, 2019 ​ ​ Amortized ​ Gross Unrealized ​ Fair ​ Cost Gain Loss Value Available for sale: ​ ​ ​ ​ U.S. Treasury securities ​ $ 122,634 ​ $ 170 ​ $ (1) ​ $ 122,803 Mortgage-backed securities ​ ​ 23,028 ​ ​ 76 ​ ​ — ​ ​ 23,104 Collateralized mortgage obligations ​ 1,138 ​ 45 ​ — ​ 1,183 Collateralized debt obligations ​ 216 ​ — ​ (17) ​ 199 Total ​ $ 147,016 ​ $ 291 ​ $ (18) ​ $ 147,289 ​ Securities with a fair value of $24,987 were pledged as collateral on FHLB borrowings at September 30, 2020. All of the Company's mortgage-backed securities and the majority of the Company's collateralized mortgage obligations are issued and/or guaranteed by a U.S. government agency (Government National Mortgage Association) or a U.S. government-sponsored enterprise (Federal Home Loan Mortgage Corporation or Federal National Mortgage Association). No securities of any single issuer, other than debt securities issued by the U.S. government, government agency and government-sponsored enterprises, were in excess of 10% of total shareholders’ equity as of September 30, 2020 and December 31, 2019. For the three and nine months ended September 30, 2020, the proceeds from sales of debt securities available for sale were $40,612 and $99,971, respectively. The Company recorded gross realized gains of $58 and gross realized losses of $78 during the three months ended September 30, 2020, and gross realized gains of $336 and gross realized losses of $157 during the nine months ended September 30, 2020. The amortized cost and fair value of debt securities available for sale issued by U.S. Treasury at September 30, 2020 are shown by contractual maturity. Mortgage-backed securities, collateralized mortgage obligations and collateralized debt obligations are disclosed separately in the table below as the expected maturities may differ from contractual maturities if borrowers have the right to call or prepay obligations with or without call or prepayment penalties. ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Amortized ​ Fair ​ Cost Value U.S. Treasury & Agency securities ​ ​ Due less than one year ​ $ 69,990 ​ $ 70,388 Due after one year through five years ​ ​ 25,000 ​ ​ 24,987 Mortgage-backed securities ​ ​ 26,650 ​ ​ 26,745 Collateralized mortgage obligations ​ 120,091 ​ 120,202 Collateralized debt obligations ​ 214 ​ 184 Total ​ $ 241,945 ​ $ 242,506 ​ The table summarizes debt securities available for sale, at fair value, with unrealized losses at September 30, 2020 and December 31, 2019 aggregated by major security type and length of time the individual securities have been in a continuous unrealized loss position, as follows: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ September 30, 2020 ​ ​ Less than 12 Months ​ 12 Months or More ​ Total ​ ​ Fair ​ Unrealized ​ Fair ​ Unrealized ​ Fair ​ Unrealized ​ Value Losses Value Losses Value Losses U.S. Treasury & Agency securities ​ $ 24,987 ​ $ (13) ​ $ — ​ $ — ​ $ 24,987 ​ $ (13) Collateralized mortgage obligations ​ ​ 65,450 ​ ​ (489) ​ ​ — ​ ​ — ​ ​ 65,450 ​ ​ (489) Collateralized debt obligations ​ — ​ ​ — ​ ​ 184 ​ ​ (30) ​ ​ 184 ​ ​ (30) Total ​ $ 90,437 ​ $ (502) ​ $ 184 ​ $ (30) ​ $ 90,621 ​ $ (532) ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ December 31, 2019 ​ ​ Less than 12 Months ​ 12 Months or More ​ Total ​ ​ Fair ​ Unrealized ​ Fair ​ Unrealized ​ Fair ​ Unrealized ​ Value Losses Value Losses Value Losses U.S. Treasury securities ​ $ 5,011 ​ $ (1) ​ $ — ​ $ — ​ $ 5,011 ​ $ (1) Collateralized debt obligations ​ — ​ — ​ 199 ​ (17) ​ 199 ​ (17) Total ​ $ 5,011 ​ $ (1) ​ $ 199 ​ $ (17) ​ $ 5,210 ​ $ (18) ​ As of September 30, 2020, the debt securities portfolio consisted of 19 debt securities, with eight debt securities in an unrealized loss position. Agency collateralized mortgage obligations with a fair value of $64,910 had an unrealized loss of $467 due to interest rate and prepayment fluctuations. For debt securities in an unrealized loss position, management has both the intent and ability to hold these investments until the recovery of the decline. The fair value is expected to increase as these securities approach their maturity date or repricing date or if market yields for such investments decline. Accordingly, as of September 30, 2020, the unrealized losses in these securities are due to noncredit-related factors, including changes in interest rates and other market conditions; thus, the impairment was determined to be temporary. All interest and dividends are considered taxable. A collateralized debt obligation with a carrying value of $184 and $199 at September 30, 2020 and December 31, 2019, respectively, was rated high quality at inception, but it was subsequently rated by Moody’s as Ba1, which is defined as “speculative.” The issuers of the underlying investments (the collateral) of the collateralized debt obligation are primarily banks. Management uses in-house and third party other-than-temporary impairment evaluation models to compare the present value of expected cash flows to the previous estimate to ensure there are no adverse changes in cash flows during the period. The other-than-temporary impairment model considers the structure and term of the collateralized debt obligations and the financial condition of the underlying issuers. Assumptions used in the model include expected future default rates and prepayments. The collateralized debt obligation remained classified as available for sale and represented $30 and $17 of the unrealized losses reported at September 30, 2020 and December 31, 2019, respectively. Equity Securities Equity securities consist of an investment in a qualified community reinvestment act investment fund, which is a publicly-traded mutual fund, and an investment in Pacific Coast Banker’s Bank, a thinly traded, restricted stock. At September 30, 2020 and December 31, 2019, equity securities totaled $5,378 and $5,255, respectively. Equity securities with readily determinable fair values are stated at fair value with realized and unrealized gains and losses reported in income. At September 30, 2020 and December 31, 2019, equity securities with readily determinable fair values were $5,132 and $5,009, respectively. The following is a summary of unrealized and realized gains and losses recognized in the condensed consolidated statements of income during the three and nine months ended September 30, 2020 and 2019: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Three Months Ended ​ Nine Months Ended ​ ​ September 30, ​ September 30, ​ 2020 2019 2020 2019 Net gains recorded during the period on equity securities ​ $ — ​ $ 30 ​ $ 123 ​ $ 136 Less: net gains recorded during the period on equity securities sold during the period ​ — ​ ​ — ​ — ​ ​ — Unrealized gains recorded during the period on equity securities held at the reporting date ​ $ — ​ $ 30 ​ $ 123 ​ $ 136 ​ The Company has elected to account for its investment in a thinly traded, restricted stock using the measurement alternative for equity securities without readily determinable fair values. The investment was reported at $246 at both September 30, 2020 and December 31, 2019.

Loans

Loans	9 Months Ended
	Sep. 30, 2020
Loans
Loans	Note 5—Loans Major categories of loans were as follows: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ September 30, ​ December 31, ​ 2020 2019 Residential real estate ​ $ 2,183,546 ​ $ 2,476,866 Commercial real estate ​ 262,116 ​ 240,081 Construction ​ 211,460 ​ 178,376 Commercial lines of credit ​ 18,452 ​ 17,903 Other consumer ​ 8 ​ 34 Total loans ​ 2,675,582 ​ 2,913,260 Less: allowance for loan losses ​ (48,258) ​ (21,730) Loans, net ​ $ 2,627,324 ​ $ 2,891,530 ​ Loans totaling $575,125 and $933,747 were pledged as collateral on FHLB borrowings at September 30, 2020 and December 31, 2019, respectively. The table presents the activity in the allowance for loan losses by portfolio segment for the three and nine months ended September 30, 2020 and 2019: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Commercial ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential Commercial ​ Lines of Other ​ ​ ​ ​ Three Months Ended September 30, 2020 ​ Real Estate ​ Real Estate ​ Construction ​ Credit ​ Consumer ​ Unallocated ​ Total Allowance for loan losses: ​ ​ ​ ​ ​ ​ ​ Beginning balance ​ $ 18,812 ​ $ 15,770 ​ $ 11,998 ​ $ 350 ​ $ 1 ​ $ — ​ $ 46,931 Provision (recovery) for loan losses ​ (467) ​ 1,771 ​ 628 ​ 192 ​ (1) ​ — ​ 2,123 Charge offs ​ (108) ​ — ​ (707) ​ — ​ — ​ — ​ (815) Recoveries ​ 3 ​ 14 ​ 2 ​ — ​ — ​ — ​ 19 Total ending balance ​ $ 18,240 ​ $ 17,555 ​ $ 11,921 ​ $ 542 ​ $ — ​ $ — ​ $ 48,258 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Commercial ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential ​ Commercial ​ ​ ​ Lines of ​ Other ​ ​ ​ ​ ​ ​ Nine Months Ended September 30, 2020 Real Estate Real Estate Construction Credit Consumer Unallocated Total Allowance for loan losses: ​ ​ ​ ​ ​ ​ ​ Beginning balance ​ $ 12,336 ​ $ 5,243 ​ $ 3,822 ​ $ 328 ​ $ 1 ​ $ — ​ $ 21,730 Provision (recovery) for loan losses ​ 5,997 ​ 12,262 ​ 8,801 ​ 214 ​ (1) ​ — ​ 27,273 Charge offs ​ (108) ​ — ​ (707) ​ — ​ — ​ — ​ (815) Recoveries ​ 15 ​ 50 ​ 5 ​ — ​ — ​ — ​ 70 Total ending balance ​ $ 18,240 ​ $ 17,555 ​ $ 11,921 ​ $ 542 ​ $ — ​ $ — ​ $ 48,258 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Commercial ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential ​ Commercial ​ ​ ​ ​ Lines of ​ Other ​ ​ ​ ​ ​ ​ Three Months Ended September 30, 2019 Real Estate Real Estate Construction Credit Consumer Unallocated Total Allowance for loan losses: ​ ​ ​ ​ ​ ​ ​ Beginning balance ​ $ 12,758 ​ $ 3,214 ​ $ 3,067 ​ $ 780 ​ $ 1 ​ $ 1,098 ​ $ 20,918 Provision (recovery) for loan losses ​ (321) ​ 696 ​ 155 ​ (193) ​ — ​ (86) ​ 251 Charge offs ​ — ​ — ​ — ​ — ​ — ​ — ​ — Recoveries ​ 3 ​ 30 ​ 2 ​ — ​ — ​ — ​ 35 Total ending balance ​ $ 12,440 ​ $ 3,940 ​ $ 3,224 ​ $ 587 ​ $ 1 ​ $ 1,012 ​ $ 21,204 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Commercial ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential ​ Commercial ​ ​ ​ ​ Lines of ​ Other ​ ​ ​ ​ ​ ​ Nine Months Ended September 30, 2019 Real Estate Real Estate Construction Credit Consumer Unallocated Total Allowance for loan losses: ​ ​ ​ ​ ​ ​ ​ Beginning balance ​ $ 13,826 ​ $ 2,573 ​ $ 3,273 ​ $ 1,058 ​ $ 1 ​ $ 1,119 ​ $ 21,850 Provision (recovery) for loan losses ​ (1,402) ​ 1,275 ​ (54) ​ (295) ​ — ​ (107) ​ (583) Charge offs ​ — ​ — ​ — ​ (176) ​ — ​ — ​ (176) Recoveries ​ 16 ​ 92 ​ 5 ​ — ​ — ​ — ​ 113 Total ending balance ​ $ 12,440 ​ $ 3,940 ​ $ 3,224 ​ $ 587 ​ $ 1 ​ $ 1,012 ​ $ 21,204 ​ The following tables present the balance in the allowance for loan losses and the recorded investment by portfolio segment and based on impairment method as of September 30, 2020 and December 31, 2019: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Commercial ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential ​ Commercial ​ ​ ​ Lines of ​ Other ​ ​ ​ ​ ​ ​ September 30, 2020 Real Estate Real Estate Construction Credit Consumer Unallocated Total Allowance for loan losses: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Ending allowance balance attributable to loans: ​ ​ ​ ​ ​ ​ ​ ​ Individually evaluated for impairment ​ $ 41 ​ $ — ​ $ — ​ $ 4 ​ $ — ​ $ — ​ $ 45 Collectively evaluated for impairment ​ ​ 18,199 ​ ​ 17,555 ​ ​ 11,921 ​ ​ 538 ​ ​ — ​ ​ — ​ ​ 48,213 Total ending allowance balance ​ $ 18,240 ​ $ 17,555 ​ $ 11,921 ​ $ 542 ​ $ — ​ $ — ​ $ 48,258 Loans: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Loans individually evaluated for impairment ​ $ 211 ​ $ 14,153 ​ $ 46,214 ​ $ 1,244 ​ $ — ​ $ — ​ $ 61,822 Loans collectively evaluated for impairment ​ 2,183,335 ​ 247,963 ​ 165,246 ​ 17,208 ​ 8 ​ — ​ 2,613,760 Total ending loans balance ​ $ 2,183,546 ​ $ 262,116 ​ $ 211,460 ​ $ 18,452 ​ $ 8 ​ $ — ​ $ 2,675,582 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Commercial ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential ​ Commercial ​ ​ ​ Lines of ​ Other ​ ​ ​ ​ ​ ​ December 31, 2019 Real Estate Real Estate Construction Credit Consumer Unallocated Total Allowance for loan losses: ​ ​ ​ ​ ​ ​ ​ Ending allowance balance attributable to loans: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Individually evaluated for impairment ​ $ 43 ​ $ — ​ $ — ​ $ 5 ​ $ — ​ $ — ​ $ 48 Collectively evaluated for impairment ​ ​ 12,293 ​ ​ 5,243 ​ ​ 3,822 ​ ​ 323 ​ ​ 1 ​ ​ — ​ ​ 21,682 Total ending allowance balance ​ $ 12,336 ​ $ 5,243 ​ $ 3,822 ​ $ 328 ​ $ 1 ​ $ — ​ $ 21,730 Loans: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Loans individually evaluated for impairment ​ $ 215 ​ $ 1,100 ​ $ 17,112 ​ $ 1,377 ​ $ — ​ $ — ​ $ 19,804 Loans collectively evaluated for impairment ​ 2,476,651 ​ 238,981 ​ 161,264 ​ 16,526 ​ 34 ​ — ​ 2,893,456 Total ending loans balance ​ $ 2,476,866 ​ $ 240,081 ​ $ 178,376 ​ $ 17,903 ​ $ 34 ​ $ — ​ $ 2,913,260 ​ The following tables present information related to impaired loans by class of loans as of and for the periods indicated: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ At September 30, 2020 ​ At December 31, 2019 ​ ​ Unpaid ​ ​ ​ ​ Allowance ​ Unpaid ​ ​ ​ ​ Allowance ​ ​ Principal ​ Recorded ​ for Loan ​ Principal ​ Recorded ​ for Loan ​ Balance Investment Losses Balance Investment Losses With no related allowance for loan losses recorded: ​ ​ ​ ​ ​ ​ ​ Residential real estate, first mortgage ​ $ 118 ​ $ 96 ​ $ — ​ $ 125 ​ $ 98 ​ $ — Commercial real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Retail ​ ​ 1,259 ​ ​ 1,040 ​ ​ — ​ ​ 1,308 ​ ​ 1,100 ​ ​ — Hotel/Single-room occupancy hotels ​ ​ 13,126 ​ ​ 13,113 ​ ​ — ​ ​ — ​ ​ — ​ ​ — Construction ​ ​ 46,945 ​ ​ 46,214 ​ ​ — ​ ​ 17,156 ​ ​ 17,112 ​ ​ — Commercial lines of credit: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Private banking ​ ​ — ​ ​ — ​ ​ — ​ ​ 1,245 ​ ​ 1,245 ​ ​ — C&I lending ​ ​ 1,117 ​ ​ 1,117 ​ ​ — ​ ​ — ​ ​ — ​ ​ — Subtotal ​ 62,565 ​ 61,580 ​ — ​ 19,834 ​ 19,555 ​ — With an allowance for loan losses recorded: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential real estate, first mortgage ​ 114 ​ 115 ​ 41 ​ 116 ​ 117 ​ 43 Commercial lines of credit, private banking ​ ​ 127 ​ ​ 127 ​ ​ 4 ​ ​ 132 ​ ​ 132 ​ ​ 5 Subtotal ​ 241 ​ 242 ​ 45 ​ 248 ​ 249 ​ 48 Total ​ $ 62,806 ​ $ 61,822 ​ $ 45 ​ $ 20,082 ​ $ 19,804 ​ $ 48 ​ In the above tables, the unpaid principal balance is not reduced for partial charge offs. Also, the recorded investment excludes accrued interest receivable on loans which was not significant. ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Three Months Ended ​ ​ September 30, 2020 ​ September 30, 2019 ​ ​ Average ​ Interest ​ Cash Basis ​ Average ​ Interest ​ Cash Basis ​ ​ Recorded ​ Income ​ Interest ​ Recorded ​ Income ​ Interest ​ Investment Recognized Recognized Investment Recognized Recognized With no related allowance for loan losses recorded: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential real estate, first mortgage ​ $ 95 ​ $ — ​ $ — ​ $ 102 ​ $ — ​ $ — Commercial real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Retail ​ 1,050 ​ ​ 14 ​ ​ 10 ​ ​ 1,127 ​ ​ 16 ​ ​ 10 Hotel/Single-room occupancy hotels ​ ​ 13,090 ​ ​ — ​ ​ — ​ ​ — ​ ​ — ​ ​ — Construction ​ ​ 46,310 ​ ​ 221 ​ ​ 92 ​ ​ 6,492 ​ ​ 58 ​ ​ 52 Commercial lines of credit, C&I lending ​ ​ 1,151 ​ ​ — ​ ​ — ​ ​ 67 ​ ​ 1 ​ ​ 1 Subtotal ​ ​ 61,696 ​ ​ 235 ​ ​ 102 ​ 7,788 ​ 75 ​ 63 With an allowance for loan losses recorded: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential real estate, first mortgage ​ ​ 115 ​ ​ 1 ​ ​ 1 ​ 118 ​ 1 ​ 1 Commercial lines of credit, private banking ​ ​ 128 ​ ​ 2 ​ ​ 1 ​ ​ 135 ​ ​ 1 ​ ​ 1 Subtotal ​ ​ 243 ​ ​ 3 ​ ​ 2 ​ 253 ​ 2 ​ 2 Total ​ $ 61,939 ​ $ 238 ​ $ 104 ​ $ 8,041 ​ $ 77 ​ $ 65 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Nine Months Ended ​ ​ September 30, 2020 ​ September 30, 2019 ​ ​ Average ​ Interest ​ Cash Basis ​ Average ​ Interest ​ Cash Basis ​ ​ Recorded ​ Income ​ Interest ​ Recorded ​ Income ​ Interest ​ Investment Recognized Recognized Investment Recognized Recognized With no related allowance for loan losses recorded: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential real estate, first mortgage ​ $ 98 ​ $ — ​ $ — ​ $ 105 ​ $ — ​ $ — Commercial real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Retail ​ 1,079 ​ ​ 43 ​ ​ 39 ​ ​ 1,146 ​ ​ 46 ​ ​ 41 Multifamily ​ ​ — ​ ​ — ​ ​ — ​ ​ 598 ​ ​ 12 ​ ​ 12 Offices ​ ​ — ​ ​ — ​ ​ — ​ ​ 504 ​ ​ 25 ​ ​ 25 Hotel/Single-room occupancy hotels ​ ​ 13,085 ​ ​ — ​ ​ — ​ ​ — ​ ​ — ​ ​ — Construction ​ ​ 44,637 ​ ​ 1,031 ​ ​ 760 ​ ​ 8,274 ​ ​ 376 ​ ​ 370 Commercial lines of credit: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Private banking ​ ​ 934 ​ ​ 42 ​ ​ 35 ​ ​ — ​ ​ — ​ ​ — C&I lending ​ ​ 1,250 ​ ​ — ​ ​ — ​ ​ 89 ​ ​ 5 ​ ​ 5 Subtotal ​ ​ 61,083 ​ ​ 1,116 ​ ​ 834 ​ 10,716 ​ 464 ​ 453 With an allowance for loan losses recorded: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential real estate, first mortgage ​ ​ 116 ​ ​ 4 ​ ​ 3 ​ 119 ​ 4 ​ 3 Commercial lines of credit, Private banking ​ ​ 129 ​ ​ 5 ​ ​ 4 ​ ​ 137 ​ ​ 5 ​ ​ 5 Subtotal ​ ​ 245 ​ ​ 9 ​ ​ 7 ​ 256 ​ 9 ​ 8 Total ​ $ 61,328 ​ $ 1,125 ​ $ 841 ​ $ 10,972 ​ $ 473 ​ $ 461 ​ Also presented in the above table is the average recorded investment of the impaired loans and the related amount of interest recognized during the time within the period that the impaired loans were impaired. When the ultimate collectability of the total principal of an impaired loan is in doubt and the loan is on nonaccrual status, all payments are applied to principal under the cost recovery method. When the ultimate collectability of the total principal of an impaired loan is not in doubt and the loan is on nonaccrual status, contractual interest is credited to interest income when received under the cash basis method. The average balances are calculated based on the month-end balances of the loans for the period reported. The following table presents the recorded investment in nonaccrual and loans past due over 90 days still on accrual by class of loans as of September 30, 2020 and December 31, 2019: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ September 30, 2020 ​ December 31, 2019 ​ ​ ​ ​ ​ Loans Past ​ ​ ​ ​ Loans Past ​ ​ ​ ​ ​ Due Over ​ ​ ​ ​ Due Over ​ ​ ​ ​ ​ 90 Days Still ​ ​ ​ ​ 90 Days Still ​ Nonaccrual Accruing Nonaccrual Accruing Residential real estate: ​ ​ ​ ​ Residential first mortgage ​ $ 35,685 ​ $ 47 ​ $ 14,482 ​ $ 50 Residential second mortgage ​ ​ 688 ​ ​ — ​ ​ 210 ​ ​ — Commercial real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Retail ​ 25 ​ — ​ 40 ​ — Hotel/Single-room occupancy hotels ​ ​ 13,112 ​ ​ — ​ ​ — ​ ​ — Construction ​ ​ 32,488 ​ ​ — ​ ​ — ​ ​ — Commercial lines of credit: ​ ​ — ​ ​ ​ ​ ​ ​ ​ ​ ​ Private banking ​ ​ 1,117 ​ ​ — ​ ​ — ​ ​ — Total ​ $ 83,115 ​ $ 47 ​ $ 14,732 ​ $ 50 ​ The following tables present the aging of the recorded investment in past due loans as of September 30, 2020 and December 31, 2019 by class of loans: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Greater ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ 30 - 59 ​ 60 - 89 ​ than ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Days ​ Days ​ 89 Days ​ Total ​ Loans Not ​ ​ ​ September 30, 2020 Past Due Past Due Past Due Past Due Past Due Total Residential real estate: ​ ​ ​ ​ ​ ​ Residential first mortgage ​ $ 33,065 ​ $ 7,682 ​ $ 35,732 ​ $ 76,479 ​ $ 2,087,032 ​ $ 2,163,511 Residential second mortgage ​ 376 ​ — ​ 688 ​ 1,064 ​ 18,971 ​ 20,035 Commercial real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Retail ​ — ​ — ​ 25 ​ 25 ​ 17,705 ​ 17,730 Multifamily ​ — ​ — ​ — ​ — ​ 79,618 ​ 79,618 Offices ​ — ​ — ​ — ​ — ​ 27,381 ​ 27,381 Hotels/Single-room occupancy hotels ​ — ​ — ​ 13,112 ​ 13,112 ​ 59,875 ​ 72,987 Industrial ​ — ​ — ​ — ​ — ​ 13,323 ​ 13,323 Other ​ — ​ 1,194 ​ — ​ 1,194 ​ 49,883 ​ 51,077 Construction ​ ​ 7,146 ​ ​ 14,181 ​ ​ 32,488 ​ ​ 53,815 ​ ​ 157,645 ​ ​ 211,460 Commercial lines of credit: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Private banking ​ — ​ 1,170 ​ — ​ 1,170 ​ 2,411 ​ 3,581 C&I lending ​ — ​ — ​ 1,117 ​ 1,117 ​ 13,754 ​ 14,871 Other consumer ​ — ​ — ​ — ​ — ​ 8 ​ 8 Total ​ $ 40,587 ​ $ 24,227 ​ $ 83,162 ​ $ 147,976 ​ $ 2,527,606 ​ $ 2,675,582 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Greater ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ 30 - 59 ​ 60 - 89 ​ than ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Days ​ Days ​ 89 Days ​ Total ​ Loans Not ​ ​ ​ December 31, 2019 Past Due Past Due Past Due Past Due Past Due Total Residential real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential first mortgage ​ $ 36,112 ​ $ 5,112 ​ $ 14,532 ​ $ 55,756 ​ $ 2,396,800 ​ $ 2,452,556 Residential second mortgage ​ 97 ​ 295 ​ 210 ​ 602 ​ 23,708 ​ 24,310 Commercial real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Retail ​ — ​ — ​ 40 ​ 40 ​ 6,089 ​ 6,129 Multifamily ​ — ​ — ​ — ​ — ​ 64,873 ​ 64,873 Offices ​ — ​ — ​ — ​ — ​ 28,048 ​ 28,048 Hotel/Single-room occupancy hotels ​ 5,605 ​ — ​ — ​ 5,605 ​ 76,165 ​ 81,770 Industrial ​ — ​ — ​ — ​ — ​ 14,150 ​ 14,150 Other ​ — ​ — ​ — ​ — ​ 45,111 ​ 45,111 Construction ​ 15,008 ​ — ​ — ​ 15,008 ​ 163,368 ​ 178,376 Commercial lines of credit: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Private banking ​ — ​ — ​ — ​ — ​ 11,914 ​ 11,914 C&I lending ​ 1,249 ​ — ​ — ​ 1,249 ​ 4,740 ​ 5,989 Other consumer ​ — ​ — ​ — ​ — ​ 34 ​ 34 Total ​ $ 58,071 ​ $ 5,407 ​ $ 14,782 ​ $ 78,260 ​ $ 2,835,000 ​ $ 2,913,260 ​ The Company considers the performance of the loan portfolio and its impact on the allowance for loan losses. For residential real estate and other consumer loans, the Company also evaluates credit quality based on the aging status of the loan, which is presented above, and by payment activity. The Company reviews the status of nonperforming loans which include loans 90 days past due and still accruing and nonaccrual loans. As a response to COVID-19, the Company has offered forbearance under the Coronavirus Aid, Relief, and Economic Security (“CARES”) Act to customers facing COVID-19 related financial difficulties. The Company is not adjusting the aging of loans for customers granted a payment deferral in response to COVID-19. These loans remain in the aging category that was applicable at the time of payment deferral. Interest continues to accrue on these loans. Troubled Debt Restructurings At September 30, 2020 and December 31, 2019, the balance of outstanding loans identified as troubled debt restructurings was $27,585 and $13,708, respectively. The allocated portion of the allowance for loan losses with respect to these loans was $45 and $48 at September 30, 2020 and December 31, 2019, respectively. Four construction loans totaling $12,482 identified as troubled debt restructurings subsequently defaulted. The effect of the defaults on the allowance for loan losses was not significant due to collateral coverage. During the nine months ended September 30, 2020, the Bank modified the terms of three construction loans and one private banking loan by providing for an extension of the maturity dates at the contract's existing rate of interest, which is lower than the current market rate for new debt with similar risk. The outstanding recorded investment was $13,777 both before and after modification. During the nine months ended September 30, 2019, the Bank modified the terms of a construction loan by providing for an extension of the maturity dates at the contract’s existing rate of interest, which is lower than the current market rate for new debt with similar risk. The outstanding recorded investment was $1,046 both before and after modification. The effect of the modification on the allowance for loan losses was not significant. The terms of certain other loans have been modified during the nine months ended September 30, 2020 and 2019 that did not meet the definition of a troubled debt restructuring. These other loans that were modified were not considered significant. Certain provisions of the CARES Act encourage financial institutions to practice prudent efforts to work with borrowers impacted by COVID-19. Under these provisions, a modification deemed to be COVID-19 related would not be considered a troubled debt restructuring if the loan was not more than 30 days past due as of December 31, 2019 and the deferral was executed between March 1, 2020 and the earlier of 60 days after the date of termination of the COVID-19 national emergency or December 31, 2020. The banking regulators issued similar guidance, which also clarified that a COVID-19 related modification should not be considered a troubled debt restructuring if the borrower was current on payments at the time the underlying loan modification program was implemented and if the modification is considered to be short-term. Under these terms, the Company had implemented a COVID-19 forbearance program that generally provided for principal and interest forbearance for 120 days to residential and commercial borrowers and these loans were not considered troubled debt restructurings. As of September 30, 2020, there are 75 loans that remain in payment deferral totaling $54,413. Total accrued interest receivables on these loans were $1,055. Foreclosure Proceedings At September 30, 2020 and December 31, 2019, the recorded investment of consumer mortgage loans secured by residential real estate properties for which formal foreclosure proceedings are in process is $13,962 and $1,643, respectively. Credit Quality The Company categorizes loans into risk categories based on relevant information about the ability of borrowers to service their debt such as: current financial information, historical payment experience, credit documentation, public information, and current economic trends, among other factors. The Company analyzes loans individually by classifying the loans as to credit risk. This analysis includes homogeneous loans such as residential real estate and other consumer loans and non-homogeneous loans, such as commercial lines of credit, construction and commercial real estate loans. This analysis is performed at least quarterly. The Company uses the following definitions for risk ratings: Pass: Loans are of satisfactory quality. Special Mention: Loans classified as special mention have a potential weakness that deserves management’s close attention. If left uncorrected, these potential weaknesses may result in deterioration of the repayment prospects for the loan or of the Company’s credit position at some future date. Substandard: Loans classified as substandard are inadequately protected by the current net worth and paying capacity of the obligor or of the collateral pledged, if any. Loans so classified have a well-defined weakness or weaknesses that jeopardize the liquidation of the debt. They are characterized by the distinct possibility that the Company will sustain some loss if the deficiencies are not corrected. Doubtful: Loans classified as doubtful have all the weaknesses inherent in those classified as substandard, with the added characteristic that the weaknesses make collection or liquidation in full, based on currently existing facts, conditions, and values, highly questionable and improbable. At September 30, 2020 and December 31, 2019, the risk rating of loans by class of loans was as follows: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Special ​ ​ ​ ​ ​ ​ ​ ​ ​ September 30, 2020 Pass Mention Substandard Doubtful Total Residential real estate: ​ ​ ​ ​ ​ ​ Residential first mortgage ​ $ 2,127,778 ​ $ — ​ $ 35,637 ​ $ 96 ​ $ 2,163,511 Residential second mortgage ​ 19,347 ​ — ​ 688 ​ — ​ 20,035 Commercial real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Retail ​ 15,110 ​ 1,580 ​ 1,040 ​ — ​ 17,730 Multifamily ​ 58,679 ​ 12,596 ​ 8,343 ​ — ​ 79,618 Offices ​ 12,097 ​ 1,633 ​ 13,651 ​ — ​ 27,381 Hotels/Single-room occupancy hotels ​ 9,207 ​ 22,974 ​ 40,806 ​ — ​ 72,987 Industrial ​ 5,874 ​ — ​ 7,449 ​ — ​ 13,323 Other ​ 36,237 ​ 9,023 ​ 5,817 ​ — ​ 51,077 Construction ​ 152,261 ​ 25,882 ​ 33,317 ​ — ​ 211,460 Commercial lines of credit: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Private banking ​ 1,296 ​ 2,285 ​ — ​ — ​ 3,581 C&I lending ​ 13,754 ​ — ​ 1,117 ​ — ​ 14,871 Other consumer ​ 8 ​ — ​ — ​ — ​ 8 Total ​ $ 2,451,648 ​ $ 75,973 ​ $ 147,865 ​ $ 96 ​ $ 2,675,582 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Special ​ ​ ​ ​ ​ ​ ​ ​ ​ December 31, 2019 Pass Mention Substandard Doubtful Total Residential real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential first mortgage ​ $ 2,438,024 ​ $ — ​ $ 14,077 ​ $ 455 ​ $ 2,452,556 Residential second mortgage ​ 24,100 ​ — ​ 210 ​ — ​ 24,310 Commercial real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Retail ​ 4,195 ​ 834 ​ 1,100 ​ — ​ 6,129 Multifamily ​ 56,164 ​ 7,150 ​ 1,559 ​ — ​ 64,873 Offices ​ 24,484 ​ 645 ​ 2,919 ​ — ​ 28,048 Hotels/Single-room occupancy hotels ​ 60,074 ​ 18,189 ​ 3,507 ​ — ​ 81,770 Industrial ​ 5,894 ​ 8,256 ​ — ​ — ​ 14,150 Other ​ 37,693 ​ 920 ​ 6,498 ​ — ​ 45,111 Construction ​ 156,339 ​ 7,008 ​ 15,029 ​ — ​ 178,376 Commercial lines of credit: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Private banking ​ 10,669 ​ 1,245 ​ — ​ — ​ 11,914 C&I lending ​ 4,013 ​ — ​ 1,976 ​ — ​ 5,989 Other consumer ​ 34 ​ — ​ — ​ — ​ 34 Total ​ $ 2,821,683 ​ $ 44,247 ​ $ 46,875 ​ $ 455 ​ $ 2,913,260 ​ During the three and nine months ended September 30, 2019, the Bank sold pools of residential real estate mortgages for $51,591 and $173,397, respectively, to third-party investors. The transactions resulted in full de-recognition of the mortgages (i.e. transferred assets) from the condensed consolidated balance sheets and recognition of gain on sale of portfolio loans of $1,683 and $5,985 for the three and nine months ended September 30, 2019, respectively. After the sales, the Bank’s only continuing involvement in the transferred assets is to act as servicer or subservicer of the mortgages. During the three and nine months ended September 30, 2020, the Bank negotiated the repurchases of pools of Advantage Loan Program loans with a total outstanding principal balance of $30,934 and $69,638, respectively. The Company recognized a loss of $135 and $271 in other non-interest expense in connection with these repurchases for the three and nine months ended September 30, 2020, respectively. For more information on repurchase exposures, see Note 16-Commitments and Contingencies.

Mortgage Servicing Rights, net

Mortgage Servicing Rights, net	9 Months Ended
	Sep. 30, 2020
Mortgage Servicing Rights, net
Mortgage Servicing Rights, net	Note 6—Mortgage Servicing Rights, net The Bank records servicing assets from the sale of residential real estate mortgage loans to the secondary market for which servicing has been retained. Residential real estate mortgage loans serviced for others are not included in the condensed consolidated balance sheets. The principal balance of these loans at September 30, 2020 and December 31, 2019 are as follows: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ September 30, ​ December 31, ​ 2020 2019 Residential ​ ​ FNMA ​ $ 176,052 ​ $ 130,425 FHLB ​ 72,416 ​ 86,778 Private investors ​ 471,893 ​ 656,035 Total ​ $ 720,361 ​ $ 873,238 ​ Custodial escrow balances maintained with these serviced loans were $9,583 and $7,688 at September 30, 2020 and December 31, 2019, respectively. Activity for mortgage servicing rights and the related valuation allowance are as follows: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Three Months Ended ​ Nine Months Ended ​ ​ September 30, ​ September 30, ​ 2020 2019 2020 2019 Mortgage servicing rights: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Beginning of period ​ $ 9,569 ​ $ 11,073 ​ $ 10,845 ​ $ 10,733 Additions ​ ​ 119 ​ ​ 903 ​ 609 ​ 2,765 Amortization ​ ​ (1,123) ​ ​ (666) ​ (2,889) ​ (2,188) End of period ​ ​ 8,565 ​ ​ 11,310 ​ 8,565 ​ 11,310 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Valuation ​ ​ 2,303 ​ ​ 1,301 ​ 1,080 ​ 100 Additions (recoveries) ​ ​ (161) ​ ​ 99 ​ 1,062 ​ 1,300 Valuation allowance at end of period ​ ​ 2,142 ​ ​ 1,400 ​ 2,142 ​ 1,400 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Mortgage servicing rights, net ​ $ 6,423 ​ $ 9,910 ​ $ 6,423 ​ $ 9,910 ​ Servicing fee income, net of amortization of servicing rights and changes in the valuation allowance, was $(121) and $240 for the three months ended September 30, 2020 and 2019, respectively, and $(1,239) and $(437) for the nine months ended September 30, 2020 and 2019, respectively. The fair value of mortgage servicing rights was $6,603 and $10,271 at September 30, 2020 and December 31, 2019, respectively. The fair value of mortgage servicing rights is highly sensitive to changes in underlying assumptions. Changes in prepayment speed assumptions have the most significant impact on the estimate of the fair value of mortgage servicing rights. The fair value at September 30, 2020 was determined using discount rates ranging from 9.5% to 12.0%, prepayment speeds ranging from 6.8% to 38.5%, depending on the stratification of the specific right, and a weighted average default rate of 0.2%. The fair value at December 31, 2019 was determined using discount rates ranging from 9.5% to 12.0%, prepayment speeds ranging from 6.8% to 47.1%, depending on the stratification of the specific right, and a weighted average default rate of 0.2%. At September 30, 2020 and December 31, 2019, the carrying amount of certain individual groupings exceeded their fair values. See Note 13─Fair Values of Financial Instruments.

Deposits

Deposits	9 Months Ended
	Sep. 30, 2020
Deposits
Deposits	Note 7—Deposits Time deposits, included in interest-bearing deposits, were $1,687,883 and $1,154,076 at September 30, 2020 and December 31, 2019, respectively. Time deposits included brokered deposits of $42,751 and $25,000 at September 30, 2020 and December 31, 2019, respectively. Time deposits that meet or exceed the FDIC insurance limit of $250 were $498,264 and $283,457 at September 30, 2020 and December 31, 2019, respectively.

FHLB Borrowings

FHLB Borrowings	9 Months Ended
	Sep. 30, 2020
FHLB Borrowings
FHLB Borrowings	Note 8—FHLB Borrowings FHLB borrowings at September 30, 2020 and December 31, 2019 consist of the following: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ September 30, ​ ​ ​ December 31, ​ ​ ​ 2020 Interest Rates 2019 Interest Rates Long-term fixed rate advances ​ $ 318,000 0.43% - 1.96% ​ $ 229,000 1.07% - 1.96% ​ FHLB Advances The long-term fixed rate advances have maturity dates ranging from July 2021 to February 2030. Interest on these advances is payable monthly and each advance is payable at its maturity date, and may contain a prepayment penalty if paid before maturity. At September 30, 2020, advances totaling $307,000 were callable by the FHLB as follows: $100,000 in November 2020; $67,000 in September 2021; $90,000 in October 2021; and $50,000 in May 2024. At September 30, 2020, the Bank had additional borrowing capacity of $44,523 from the FHLB. FHLB Overdraft Line of Credit The Bank has established an overdraft line of credit agreement with the FHLB providing maximum borrowings of $50,000. The average amount outstanding during the nine months ended September 30, 2020 and 2019 was $24 and $2,566, respectively. Borrowings accrue interest based on a variable rate based on the FHLB’s overnight cost of funds rate, which was 0.50% and 1.99% at September 30, 2020 and December 31, 2019, respectively. The agreement has a one-year term and was renewed in October 2020 on substantially the same terms until October 2021. The FHLB advances and the overdraft line of credit are collateralized by pledged securities and loans. Refer to Note 4─Investment Securities for further information on securities pledged and Note 5─Loans for further information on loans pledged. Other Borrowings The Bank had available unsecured credit lines with other banks totaling $100,000 and $70,000 at September 30, 2020 and December 31, 2019, respectively. There were no borrowings under these credit lines during the nine months ended September 30, 2020 or the year ended December 31, 2019.

Subordinated Notes, net

Subordinated Notes, net	9 Months Ended
	Sep. 30, 2020
Subordinated Notes, net
Subordinated Notes, net	Note 9—Subordinated Notes, net The subordinated notes (the "Notes") were as follows: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ September 30, ​ December 31, ​ 2020 2019 7.0% fixed to floating rate subordinated notes ​ $ 65,000 ​ $ 65,000 Unamortized note premium ​ 427 ​ 474 Unamortized debt issuance costs ​ (127) ​ (295) Total ​ $ 65,300 ​ $ 65,179 ​ The Notes bear interest at 7% per annum, payable semi-annually on April 15 and October 15 in arrears, through April 2021 after which the Notes will have a variable interest rate of the three-month London Interbank Offered Rate (“LIBOR”) rate plus a margin of 5.82%. Premiums and debt issuance costs are amortized over the contractual term of the Notes into interest expense using the effective interest method. Interest expense on these Notes was $1,178 and $1,175 for the three months ended September 30, 2020 and 2019, respectively, and $3,533 and $3,524 for the nine months ended September 30, 2020 and 2019, respectively. The Notes mature in April 2026. On or after April 14, 2021, the Company may redeem the Notes, in whole or in part, at an amount equal to 100% of the outstanding principal amount being redeemed plus accrued interest, in a principal amount with integral multiples of $1. The Notes are not redeemable by the Company prior to April 14, 2021 except in the event that (i) the Notes no longer qualify as Tier 2 Capital, (ii) the interest on the Notes is determined by law to be not deductible for Federal Income Tax reporting or (iii) the Company is considered an investment company pursuant to the Investment Company Act of 1940. The Notes are not subject to redemption by the noteholder. The Notes are unsecured obligations and are subordinated in right of payment to all existing and future indebtedness, deposits and other liabilities of the Company’s current and future subsidiaries, including the Bank’s deposits as well as the Company’s subsidiaries liabilities to general creditors and liabilities arising during the ordinary course of business. The Notes may be included in Tier 2 capital for the Company under current regulatory guidelines and interpretations. As long as the Notes are outstanding, the Company is permitted to pay dividends if prior to such dividends, the Bank is considered well capitalized, as defined in Note 14─Regulatory Capital Requirements.

Stock Repurchase Program

Stock Repurchase Program	9 Months Ended
	Sep. 30, 2020
Stock Repurchase Program
Stock Repurchase Program	Note 10—Stock Repurchase Program In late 2018, the board of directors approved the repurchase of up to $50,000 of the Company’s outstanding shares of common stock. The stock repurchase program permits the Company to purchase shares of its common stock from time to time in the open market or in privately negotiated transactions. The program does not have an expiration date. The Company received regulatory approval of its stock repurchase program and publicly announced the program in January 2019. Under this program, the Company is not obligated to repurchase shares of its common stock. The repurchased shares will be canceled and returned to authorized but unissued status. During the nine months ended September 30, 2020, the Company repurchased and cancelled 10,912 shares of its common stock for $82, including commissions and fees (average repurchase price of $7.57 per share). Such repurchases of common stock were funded through cash generated from operations. As of September 30, 2020, the Company had $19,568 of common stock purchases remaining that may be made under the program. In March 2020, the Company suspended the stock repurchase program for at least the near term in connection with the issues giving rise to the internal review of the Advantage Loan Program (the "Internal Review"), which has been led by outside legal counsel under the direction of a special committee of independent directors (the "Special Committee"). The primary focus of the Internal Review has involved the origination of residential mortgage loans under the Advantage Loan Program and related matters. Refer to Note 16─Commitments and Contingencies for further information regarding the Internal Review.

Stock-based Compensation

Stock-based Compensation	9 Months Ended
	Sep. 30, 2020
Stock-based Compensation
Stock-based Compensation	Note 11—Stock-based Compensation The board of directors established a 2017 Omnibus Equity Incentive Plan (the “Plan”) which was approved by the shareholders. The Plan provides for the grant of up to 4,237,100 shares of common stock for stock options, stock appreciation rights, restricted stock, restricted stock units and other stock-based awards for issuance to employees, consultants and board of directors of the Company. The stock-based awards are issued at no less than the market price on the date the awards are granted. Stock Options Stock option awards are granted with an exercise price equal to the market price of the Company’s common stock on the date of grant. Stock option awards granted prior to 2020 generally vest in installments of 50% in each of the third and fourth year after the date of grant, while stock options awards granted in 2020 vest ratably over three years ( 33% per year ) after the date of grant. All stock option awards have a maximum term of ten years . The fair value of each stock option award is estimated on the date of grant using the Black-Scholes option pricing model that uses the assumptions noted below. Estimating the grant date fair values for employee stock options requires management to make assumptions regarding expected volatility of the value of those underlying shares, the risk-free rate over the expected life of the stock options and the date on which share-based payments will be settled. Expected volatilities are based on a weighted average of the Company’s historic volatility and an implied volatility for a group of industry-relevant bank holding companies as of the measurement date. The expected term of options granted is calculated using the simplified method (the midpoint between the end of the vesting period and the end of the maximum term). The risk-free rate for the expected term of the option is based upon U.S. Treasury yield curve in effect at the time of grant. Expected dividend yield represents what the Company anticipates will be declared during the expected term of the options. On March 2, 2020, the board of directors approved the issuance of options to purchase 67,361 shares of common stock with an exercise price of $7.10 to certain key employees, which are accounted for as equity awards. These options to purchase shares of common stock had a weighted average grant-date fair value of $1.78 per option. In connection with Mr. O'Brien entering into an Employment Agreement with the Company on May 31, 2020, on June 5, 2020 the Company granted Mr. O'Brien options to purchase 300,000 shares of common stock with an exercise price of $4.00 per share. The options vest 1/3 on January 1, 2021, 1/3 on the first anniversary of the date of grant, and 1/3 on January 1, 2022 subject to his remaining employed on the vesting date; provided that the unvested portion of the Option would vest immediately in full upon Mr. O'Brien's termination of employment due to "death" or "disability" and would vest immediately in full upon a "change of control" (each, as defined in Mr. O'Brien's Employment Agreement). In the event of termination of employment other than termination for "cause" (as defined in Mr. O'Brien's Employment Agreement), if the Option is exercisable at the time of such termination of employment, it will remain exercisable for three years following termination, provided that Mr. O'Brien remains in compliance with certain terms contained in his Employment Agreement. The Company is required to cause such equity awards to be registered with the SEC as soon as practicable following the Company's eligibility to do so. The options have a maximum term of ten years . The grant-date fair value of each stock option award was estimated using the Black-Scholes option pricing model that uses the weighted average assumptions set forth in the following table: ​ ​ ​ ​ ​ ​ Exercise price of options $ 4.57 Risk-free interest rate ​ 0.49 % Expected term (in years) ​ 5.61 ​ Expected stock price volatility ​ 33.91 % Dividend yield ​ 0.10 % ​ A summary of the Company's stock option activity as of and for the nine months ended September 30, 2020 is as follows: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Weighted ​ ​ ​ ​ ​ ​ Weighted ​ Average ​ ​ ​ ​ ​ ​ Average ​ Remaining ​ Aggregate ​ ​ Number ​ Exercise ​ Contractual ​ Intrinsic ​ of Shares Price Term Value ​ ​ ​ ​ ​ ​ ​ (Years) ​ ​ Outstanding at January 1, 2020 ​ 142,477 $ 12.29 ​ 8.60 ​ $ — Granted ​ 367,361 ​ ​ 4.57 ​ ​ ​ ​ ​ Exercised ​ — ​ ​ — ​ ​ ​ ​ ​ Forfeited /expired ​ (112,018) ​ ​ 9.85 ​ ​ ​ ​ ​ Outstanding at September 30, 2020 ​ 397,820 $ 5.86 ​ 9.29 $ — ​ The Company recorded stock-based compensation expense associated with stock options of $57 and $43 for the three months ended September 30, 2020 and 2019, respectively, and $112 and $114 for the nine months ended September 30, 2020 and 2019, respectively. At September 30, 2020, there was $389 of total unrecognized compensation cost related to nonvested stock options granted under the Plan. The cost is expected to be recognized over a weighted-average period of 1.25 years. No options are exercisable at September 30, 2020. Restricted Stock Awards On March 2, 2020, the board of directors approved the issuance of 141,374 restricted stock awards to certain key employees. On September 22, 2020, the board of directors approved the issuance of 2,500 restricted stock awards to a key employee. The restricted stock awards vest ratably over three years (33% per year ) after the date of grant. Upon a change in control, as defined in the Plan, the outstanding restricted stock awards will immediately vest. The value of a restricted stock award is based on the market value of the Company’s common stock at the date of grant reduced by the present value of dividends per share expected to be paid during the period the shares are not vested. A summary of the Company's restricted stock awards activity for the nine months ended September 30, 2020 is as follows: ​ ​ ​ ​ ​ ​ ​ ​ ​ Weighted Average ​ ​ Number ​ Grant Date ​ ​ of Shares ​ Fair Value ​ ​ ​ ​ ​ ​ Nonvested at January 1, 2020 100,096 ​ $ 11.02 Granted 143,874 ​ 6.91 Vested (10,460) ​ 9.52 Forfeited (100,226) ​ 9.15 Nonvested at September 30, 2020 133,284 ​ $ 8.11 ​ The fair value of the award is recorded as compensation expense on a straight-line basis over the vesting period. The Company recorded stock-based compensation expense associated with restricted stock awards of $1 and $103 for the three months ended September 30, 2020 and 2019, respectively, and $64 and $311 for the nine months ended September 30, 2020 and 2019, respectively. At September 30, 2020, there was $750 of total unrecognized compensation cost related to the nonvested stock granted under the Plan. The cost is expected to be recognized over a weighted-average period of 2.36 years.

Income (Loss) Per Share

Income (Loss) Per Share	9 Months Ended
	Sep. 30, 2020
Income (Loss) Per Share
Income (Loss) Per Share	Note 12—Income (Loss) Per Share Basic income per common share is computed by dividing net income by the weighted average number of common shares outstanding during the period. Diluted income per common share further includes any common shares available to be issued upon the exercise of outstanding stock options and restricted stock awards if such inclusions would be dilutive. The Company determines the potentially dilutive common shares using the treasury stock method. The following table presents the computation of income (loss) per share, basic and diluted: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Three Months Ended ​ Nine Months Ended ​ ​ September 30, ​ September 30, ​ 2020 2019 2020 2019 Numerator: ​ ​ ​ ​ Net income (loss) ​ $ (111) ​ $ 13,884 ​ $ (1,274) ​ $ 43,001 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Denominator: ​ ​ ​ ​ ​ ​ ​ ​ Weighted average common shares outstanding, basic ​ 49,843,925 ​ 50,428,108 ​ 49,839,860 ​ 51,490,046 Weighted average effect of potentially dilutive common shares: ​ ​ ​ ​ ​ ​ ​ ​ Stock options ​ — ​ — ​ — ​ — Restricted stock ​ — ​ 13,464 ​ — ​ 10,611 Weighted average common shares outstanding, diluted ​ 49,843,925 ​ 50,441,572 ​ 49,839,860 ​ 51,500,657 ​ ​ ​ ​ ​ ​ ​ ​ ​ Income (loss) per share ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Basic ​ $ (0.00) ​ $ 0.28 ​ $ (0.03) ​ $ 0.84 Diluted ​ $ (0.00) ​ $ 0.28 ​ $ (0.03) ​ $ 0.83 ​ The weighted average effect of certain stock options and nonvested restricted stock which were excluded from the computation of weighted average diluted shares outstanding as inclusion of such items would be anti-dilutive, are summarized as follows: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Three Months Ended Nine Months Ended ​ ​ September 30, ​ September 30, ​ 2020 2019 2020 2019 Stock options 397,820 174,514 353,018 175,514 Restricted stock 133,284 — 177,016 38,235 Total 531,104 174,514 530,034 213,749 ​

Fair Values of Financial Instru

Fair Values of Financial Instruments	9 Months Ended
	Sep. 30, 2020
Fair Values of Financial Instruments
Fair Values of Financial Instruments	Note 13—Fair Values of Financial Instruments Financial instruments include assets carried at fair value, as well as certain assets and liabilities carried at cost or amortized cost but disclosed at fair value in these condensed consolidated financial statements. Fair value is defined as the exit price, the price that would be received for an asset or paid to transfer a liability in the most advantageous market for the asset or liability in an orderly transaction between market participants on the measurement date under current market conditions. The inputs to valuation techniques used to measure fair value are prioritized into a three-level hierarchy. The hierarchy gives the highest priority to quoted prices in active markets for identical assets and liabilities and the lowest priority to unobservable inputs. The fair value hierarchy is as follows: Level 1: Quoted prices (unadjusted) for identical assets or liabilities in active markets that the entity has the ability to access as of the measurement date. Level 2: Significant other observable inputs other than Level 1 prices such as quoted prices for similar assets or liabilities; quoted prices in markets that are not active; or other inputs that are observable or can be corroborated by observable market data. Level 3: Significant unobservable inputs that reflect a reporting entity’s own assumptions about the assumptions that market participants would use in pricing an asset or liability. The following methods and significant assumptions are used to estimate fair value: Investment Securities The fair values for investment securities are determined by quoted market prices, if available (Level 1). For securities where quoted prices are not available, fair values are calculated based on market prices of similar investment securities (Level 2). For investment securities where quoted prices or market prices of similar investment securities are not available, fair values are calculated using discounted cash flows or other market indicators (Level 3). Discounted cash flows are calculated using spread to LIBOR curves that are updated to incorporate loss severities, volatility, credit spread and optionality. During times when trading is more liquid, broker quotes are used (if available) to validate the analysis. Rating agency and industry research reports as well as defaults and deferrals on individual investment securities are reviewed and incorporated into the calculations. Mortgage Servicing Rights Fair value of mortgage servicing rights is initially determined at the individual grouping level based on an internal valuation model that calculates the present value of estimated future net servicing income. On a quarterly basis, mortgage servicing rights are evaluated for impairment based upon third party valuations obtained. As disclosed in Note 5, the valuation model utilizes interest rate, prepayment speed, and default rate assumptions that market participants would use in estimating future net servicing income (Level 3). Assets Measured at Fair Value on a Recurring Basis The table below presents the assets measured at fair value on a recurring basis categorized by the level of inputs used in the valuation of each asset at September 30, 2020 and December 31, 2019: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Fair Value Measurements at ​ ​ September 30, 2020 ​ ​ ​ ​ ​ Quoted Prices ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ in Active ​ Significant ​ ​ ​ ​ ​ ​ ​ ​ Markets for ​ Other ​ Significant ​ ​ ​ ​ ​ Identical ​ Observable ​ Unobservable ​ ​ ​ ​ ​ Assets ​ Inputs ​ Inputs ​ Total (Level 1) (Level 2) (Level 3) Financial Assets ​ ​ ​ ​ Available for sale debt securities: ​ ​ ​ ​ U.S. Treasury & Agency securities ​ $ 95,375 ​ $ 45,371 ​ $ 50,004 ​ $ — Mortgage-backed securities ​ ​ 26,745 ​ ​ — ​ ​ 26,745 ​ ​ — Collateralized mortgage obligations ​ 120,202 ​ — ​ 120,202 ​ — Collateralized debt obligations ​ 184 ​ — ​ — ​ 184 Equity securities ​ 5,132 ​ 5,132 ​ — ​ — ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Fair Value Measurements at ​ ​ December 31, 2019 ​ ​ ​ ​ ​ Quoted Prices ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ in Active ​ Significant ​ ​ ​ ​ ​ ​ ​ ​ Markets for ​ Other ​ Significant ​ ​ ​ ​ ​ Identical ​ Observable ​ Unobservable ​ ​ ​ ​ ​ Assets ​ Inputs ​ Inputs ​ Total (Level 1) (Level 2) (Level 3) Financial Assets ​ ​ ​ ​ Available for sale debt securities: ​ ​ ​ ​ U.S. Treasury securities ​ $ 122,803 ​ $ 122,803 ​ $ — ​ $ — Mortgage-backed securities ​ ​ 23,104 ​ ​ — ​ ​ 23,104 ​ ​ — Collateralized mortgage obligations ​ 1,183 ​ — ​ 1,183 ​ — Collateralized debt obligations ​ 199 ​ — ​ — ​ 199 Equity securities ​ ​ 5,009 ​ ​ 5,009 ​ ​ — ​ ​ — ​ The table below presents a reconciliation for all assets measured at fair value on a recurring basis using significant unobservable inputs (Level 3) at September 30, 2020 and 2019: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Fair Value Measurements Using Significant ​ ​ Unobservable Inputs (Level 3) ​ ​ Collateralized Debt Obligations ​ September 30, 2020 September 30, 2019 Balance of recurring Level 3 assets at beginning of period ​ $ 199 ​ $ 297 Total gains or losses (realized/unrealized): ​ ​ ​ Included in income-realized ​ — ​ — Included in other comprehensive income (loss) ​ (13) ​ (6) Principal maturities/settlements ​ ​ (2) ​ ​ (91) Sales ​ — ​ — Transfers in and/or out of Level 3 ​ — ​ — Balance of recurring Level 3 assets at end of period ​ $ 184 ​ $ 200 ​ Unrealized losses on Level 3 investments for collateralized debt obligations was $30 and $17 at September 30, 2020 and December 31, 2019, respectively. In addition to the amounts included in income as presented in the table above, interest income recorded on collateralized debt obligations was $5 and $10 for the nine months ended September 30, 2020 and 2019, respectively. The fair value of the collateralized debt obligations is obtained from third party pricing information. It is determined by calculating discounted cash flows using LIBOR curves plus spreads that adjust for credit risk and illiquidity. The Company also performs an internal analysis that considers the structure and term of the collateralized debt obligations and the financial condition of the underlying issuers to corroborate the information used from the independent third party. Assets Measured at Fair Value on a Non-Recurring Basis From time to time, the Bank may be required to measure certain other assets at fair value on a nonrecurring basis in accordance with U.S. GAAP. These adjustments to fair value usually result from the application of lower of cost or fair value accounting or write-downs of individual assets. For assets measured at fair value on a nonrecurring basis which were still held in the condensed consolidated balance sheet at September 30, 2020 and December 31, 2019, the following table provides the level of valuation assumptions used to determine each adjustment and the related carrying value: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Fair Value Measurements at September 30, 2020 ​ ​ ​ Quoted Prices in Significant ​ ​ ​ ​ ​ ​ ​ Active Markets ​ Other ​ Significant ​ ​ ​ ​ ​ for Identical ​ Observable ​ Unobservable ​ ​ ​ ​ Assets ​ Inputs ​ Inputs ​ ​ Fair Value ​ (Level 1) ​ (Level 2) ​ (Level 3) Mortgage servicing rights ​ $ 6,181 ​ $ — ​ $ — ​ $ 6,181 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Fair Value Measurements at December 31, 2019 ​ ​ ​ Quoted Prices in Significant ​ ​ ​ ​ ​ ​ ​ Active Markets ​ Other ​ Significant ​ ​ ​ ​ ​ for Identical ​ Observable ​ Unobservable ​ ​ ​ ​ Assets ​ Inputs ​ Inputs ​ ​ Fair Value ​ (Level 1) ​ (Level 2) ​ (Level 3) Mortgage servicing rights ​ $ 7,949 ​ $ — ​ $ — ​ $ 7,949 ​ The following table presents quantitative information about Level 3 fair value measurements for the financial instruments measured at fair value on a nonrecurring basis at September 30, 2020 and December 31, 2019: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Quantitative Information about Level 3 Fair Value Measurements at September 30, 2020 ​ ​ ​ ​ ​ ​ ​ ​ ​ Range ​ Fair Value Valuation Technique Unobservable Inputs (Weighted Average) (1) Mortgage servicing rights ​ $ 6,181 ​ Discounted ​ Discount rate ​ 9.5% - 12.0% ​ ​ ​ Prepayment speed ​ 8.7% - 38.5% ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Default rate ​ 0.0% - 0.3% (1) The range and weighted average for an asset category consisting of a single investment represents the significant unobservable input used in the fair value of the investment. ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Quantitative Information about Level 3 Fair Value Measurements at December 31, 2019 ​ ​ ​ ​ ​ ​ ​ ​ ​ Range ​ Fair Value Valuation Technique Unobservable Inputs ​ (Weighted Average) (1) Mortgage servicing rights ​ $ 7,949 ​ Discounted cash flow ​ Discount rate ​ 9.5% - 12.0% ​ ​ ​ ​ ​ ​ ​ Prepayment speed ​ 7.2% - 47.1% ​ ​ ​ ​ ​ ​ ​ Default rate ​ 0.1% - 0.3% (1) The range and weighted average for an asset category consisting of a single investment represents the significant unobservable input used in the fair value of the investment. ​ Fair Value of Financial Instruments The carrying amounts and estimated fair values of financial instruments not carried at fair value at September 30, 2020 and December 31, 2019, are as follows: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Fair Value Measurements at September 30, 2020 ​ ​ Carrying ​ Fair ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Amount Value Level 1 Level 2 Level 3 Financial Assets ​ ​ ​ ​ ​ ​ Cash and due from banks ​ $ 917,996 ​ $ 917,996 ​ $ 917,996 ​ $ — ​ $ — Interest-bearing time deposits with other banks ​ 7,988 ​ 8,011 ​ — ​ 8,011 ​ — Mortgage loans held for sale ​ 3,643 ​ 3,832 ​ — ​ 3,832 ​ — Loans, net ​ 2,627,324 ​ 2,680,289 ​ — ​ — ​ 2,680,289 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Financial Liabilities ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Time deposits ​ 1,687,883 ​ 1,699,441 ​ — ​ 1,699,441 ​ — Federal Home Loan Bank borrowings ​ 318,000 ​ 331,691 ​ — ​ 331,691 ​ — Subordinated notes, net ​ 65,300 ​ 66,312 ​ — ​ 66,312 ​ — ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Fair Value Measurements at December 31, 2019 ​ ​ Carrying ​ Fair ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Amount Value Level 1 Level 2 Level 3 Financial Assets ​ ​ ​ ​ ​ ​ Cash and due from banks ​ $ 77,819 ​ $ 77,819 ​ $ 77,819 ​ $ — ​ $ — Interest-bearing time deposits with other banks ​ 1,025 ​ 1,025 ​ 1,025 ​ — ​ — Mortgage loans held for sale ​ 1,337 ​ 1,368 ​ — ​ 1,368 ​ — Loans, net ​ 2,891,530 ​ 2,978,846 ​ — ​ — ​ 2,978,846 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Financial Liabilities ​ ​ ​ ​ ​ Time deposits ​ 1,154,076 ​ 1,161,490 ​ — ​ 1,161,490 ​ — Federal Home Loan Bank borrowings ​ 229,000 ​ 227,333 ​ — ​ 227,333 ​ — Subordinated notes, net ​ 65,179 ​ 65,650 ​ — ​ 65,650 ​ — ​

Regulatory Capital Requirements

Regulatory Capital Requirements	9 Months Ended
	Sep. 30, 2020
Regulatory Capital Requirements
Regulatory Capital Requirements	Note 14—Regulatory Capital Requirements The Bank is subject to the capital adequacy requirements of the OCC. The Company, as a thrift holding company, is subject to the capital adequacy requirements of the Federal Reserve. Capital adequacy guidelines and prompt corrective action regulations involve quantitative measures of assets, liabilities, and certain off-balance sheet items calculated under regulatory accounting practices. Capital amounts and classifications are also subject to qualitative judgments by regulators about components, risk weightings, and other factors, and the regulators can lower classifications in certain cases. Prompt corrective action provisions are not applicable to thrift holding companies. Failure to meet minimum capital requirements can initiate regulatory action that could have a direct material effect on the condensed consolidated financial statements. Prompt corrective action regulations provide five classifications, including well capitalized, adequately capitalized, undercapitalized, significantly undercapitalized, and critically undercapitalized, although these terms are not used to represent overall financial condition. Under the Basel III rules, the Company must hold a capital conservation buffer over the adequately capitalized risk-based capital ratios. At present, in order to avoid the imposition of restrictions on capital distributions and discretionary bonus payments, the Company is required to maintain a capital conservation buffer of at least 2.50%. The net unrealized gain or loss on investment securities is not included in regulatory capital. Banking organizations are required to maintain a minimum total capital ratio of 10.5%, a minimum Tier 1 capital ratio of 8.5% and a minimum common equity Tier 1 capital ratio of 7.0%, respectively (in each case accounting for the required capital conservation buffer). Management believes that at September 30, 2020, the Company and the Bank meet all regulatory capital requirements to which they are subject. The holding company contributed $50,000 of capital into the Bank during the first quarter of 2020. At September 30, 2020 and December 31, 2019, the Bank exceeded all capital requirements to be categorized as well-capitalized and the Company exceeded the applicable capital adequacy requirements as presented below. The Company and the Bank’s actual and minimum required capital amounts and ratios, with such regulatory minimums not including the capital conservation buffer, at September 30, 2020 and December 31, 2019 are as follows: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ For Capital ​ To be Well ​ ​ ​ Actual ​ Adequacy Purposes ​ Capitalized ​ Amount Ratio Amount Ratio Amount Ratio September 30, 2020 ​ ​ ​ ​ Total adjusted capital to risk-weighted assets ​ ​ ​ ​ Consolidated ​ $ 420,023 ​ 22.17 % $ 151,551 8.00 % ​ N/A N/A ​ Bank ​ 402,957 ​ 21.30 ​ 151,324 8.00 ​ $ 189,155 10.00 % Tier 1 (core) capital to risk-weighted assets ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Consolidated ​ 330,739 ​ 17.46 ​ 113,663 6.00 ​ N/A N/A ​ Bank ​ 379,009 ​ 20.03 ​ 113,493 6.00 ​ 151,324 8.00 ​ Common Equity Tier 1 (CET1) ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Consolidated ​ 330,739 ​ 17.46 ​ 85,247 4.50 ​ N/A N/A ​ Bank ​ 379,009 ​ 20.03 ​ 85,120 4.50 ​ 122,951 6.50 ​ Tier 1 (core) capital to adjusted tangible assets ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Consolidated ​ 330,739 ​ 8.64 ​ 153,223 4.00 ​ N/A N/A ​ Bank ​ 379,009 ​ 9.90 ​ 153,110 4.00 ​ 191,387 5.00 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ For Capital ​ To be Well ​ ​ ​ Actual ​ Adequacy Purposes ​ Capitalized ​ Amount Ratio Amount Ratio Amount Ratio December 31, 2019 ​ ​ ​ ​ Total adjusted capital to risk-weighted assets ​ ​ ​ ​ Consolidated ​ $ 419,327 21.49 % $ 156,081 8.00 % ​ N/A N/A ​ Bank ​ 346,985 17.82 ​ 155,809 8.00 ​ $ 194,761 10.00 % Tier 1 (core) capital to risk-weighted assets ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Consolidated ​ 332,418 17.04 ​ 117,061 6.00 ​ N/A N/A ​ Bank ​ 325,255 16.70 ​ 116,857 6.00 ​ 155,809 8.00 ​ Common Equity Tier 1 (CET1) ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Consolidated ​ 332,418 17.04 ​ 87,796 4.50 ​ N/A N/A ​ Bank ​ 325,255 16.70 ​ 87,643 4.50 ​ 126,595 6.50 ​ Tier 1 (core) capital to adjusted tangible assets ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Consolidated ​ 332,418 10.11 ​ 131,471 4.00 ​ N/A N/A ​ Bank ​ 325,255 9.90 ​ 131,469 4.00 ​ 164,337 5.00 ​ ​ Dividend Restrictions As noted above, banking regulations require the Bank to maintain certain capital levels and may limit the dividends paid by the bank to the holding company or by the holding company to its shareholders. The Company’s principal source of funds for dividend payments is dividends received from the Bank and banking regulations limit the dividends that may be paid. Approval by regulatory authorities is required if the total capital distributions for the applicable calendar year exceed the sum of the Bank’s net income for that year to date plus the Bank’s retained net income for the preceding two years, or the Bank would not be at least adequately capitalized following the distribution. Banking regulations also limit the ability of the Bank to pay dividends under other circumstances, including if the Bank is subject to a formal agreement with the OCC, or other supervisory enforcement action. The Qualified Thrift Lender (“QTL”) test requires that a minimum of 65% of assets be maintained in “qualified thrift investments,” including mortgage loans, housing-and real estate-related finance and other specified areas. If the QTL test is not met, limits are placed on growth, branching, new investments, FHLB Advances and dividends, or the Bank must convert to a commercial bank charter. Management believes that the QTL test has been met. Also, pursuant to the terms of the subordinated note agreements, the Company may pay dividends if it is “well capitalized” as defined by regulatory guidelines. At September 30, 2020, the Bank is currently required to obtain the prior approval of the OCC in order to pay any dividends to the Company due to the existence of a formal agreement with the OCC. See “Note 16—Commitments and Contingencies.”

Related Party Transactions

Related Party Transactions	9 Months Ended
	Sep. 30, 2020
Related Party Transactions
Related Party Transactions	Note 15—Related Party Transactions From time to time, the Company makes charitable contributions to a foundation for which certain members of the boards of directors of the Company and Bank, and who are also related to the Company’s controlling shareholders, serve as trustees. The Company has ceased making the charitable contributions during the second quarter of 2020. The Company paid $225 to the foundation during the three months ended September 30, 2019, and $375 and $675 during the nine months ended September 30, 2020 and 2019, respectively. The Bank provides monthly data processing and programming services to entities controlled by the Company’s controlling shareholders. Aggregate fees received for such services amounted to $10 and $29 during the three months ended September 30, 2020 and 2019, respectively, and $60 and $81 during the nine months ended September 30, 2020 and 2019, respectively. The Company leases certain storage and office space from entities owned by the Company’s controlling shareholders. Amounts paid under such leases totaled $57 and $46 during the three months ended September 30, 2020 and 2019, respectively, and $177 and $137 during the nine months ended September 30, 2020 and 2019, respectively. The Company also subleases certain office space to entities owned by the Company’s controlling shareholders. Amounts received under such subleases totaled $69 and $70 during the three months ended September 30, 2020 and 2019, respectively, and $207 during both the nine months ended September 30, 2020 and 2019.

Commitments and Contingencies

Commitments and Contingencies	9 Months Ended
	Sep. 30, 2020
Commitments and Contingencies
Commitments and Contingencies	Note 16—Commitments and Contingencies Financial Instruments with Off-Balance Sheet Risk The Bank is a party to financial instruments with off-balance sheet risk in the normal course of business to meet the financial needs of its customers. These financial instruments include commitments to extend credit and standby letters of credit which are not reflected in the condensed consolidated financial statements. Unfunded Commitments to Extend Credit A commitment to extend credit, such as a loan commitment, credit line and overdraft protection, is a legally binding agreement to lend funds to a customer, usually at a stated interest rate and for a specific purpose. Such commitments have fixed expiration dates and generally require a fee. The extension of a commitment gives rise to credit risk. The actual liquidity requirements or credit risk that the Bank will experience is expected to be lower than the contractual amount of commitments to extend credit because a significant portion of those commitments are expected to expire without being drawn upon. Certain commitments are subject to loan agreements containing covenants regarding the financial performance of the customer that must be met before the Bank is required to fund the commitment. The Bank uses the same credit policies in making commitments to extend credit as it does in making loans. The commitments outstanding to make loans include primarily residential real estate loans that are made for a period of 90 days or less. At September 30, 2020, outstanding commitments to make loans consisted of fixed rate loans of $18,769 with interest rates ranging from 2.375% to 4.375% and maturities ranging from 15 years to 30 years and variable rate loans of $31,424 with varying interest rates (ranging from 3.125% to 4.00% at September 30, 2020) and maturities of 30 years. Unused Lines of Credit The Bank also issues unused lines of credit to meet customer financing needs. At September 30, 2020, the unused lines of credit include residential second mortgages of $19,372, construction loans of $163,786, commercial lines of credit of $1,143 and consumer loans of $216. These unused lines of credit consisted of fixed rate loans of $253 with interest rates ranging from 5.5% to 18.0% and maturities ranging from three months to seven years and variable rate loans of $184,264 with varying interest rates (ranging from 3.25% to 10.0%) and maturities ranging from one month to ten years . Standby Letters of Credit Standby letters of credit are issued on behalf of customers in connection with construction contracts between the customers and third parties. Under standby letters of credit, the Bank assures that the third parties will receive specified funds if customers fail to meet their contractual obligations. The credit risk to the Bank arises from its obligation to make payment in the event of a customer’s contractual default. The maximum amount of potential future payments guaranteed by the Bank is limited to the contractual amount of these letters. Collateral may be obtained at exercise of the commitment. The credit risk involved in issuing letters of credit is essentially the same as that involved in extending loans to customers. The following is a summary of the total amount of unfunded commitments to extend credit and standby letters of credit outstanding at September 30, 2020 and December 31, 2019: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ September 30, ​ December 31, ​ 2020 2019 Commitments to make loans ​ $ 50,193 ​ $ 76,927 Unused lines of credit ​ 184,517 ​ 220,553 Standby letters of credit ​ 24 ​ 24 ​ Legal Proceedings The Bank is currently under formal investigation by the OCC and continues to be subject to a publicly available formal agreement with the OCC, dated June 18, 2019 (the “OCC Agreement”), relating primarily to certain aspects of its Bank Secrecy Act/Anti-Money Laundering compliance program as well as the Bank’s credit administration. The OCC Agreement generally requires that the Bank enhance its policies and procedures to ensure compliance with BSA/AML laws and regulations and ensure effective controls over residential loan underwriting. Specifically, the OCC Agreement requires the Bank to: (i) establish a compliance committee to monitor and oversee the Bank’s compliance with the provisions of OCC Agreement; (ii) develop a revised customer due diligence and enhanced due diligence program; (iii) develop a revised suspicious activity monitoring program; (iv) engage an independent, third-party consultant to review and provide a written report on the Bank’s suspicious activity monitoring; (v) develop revised policies and procedures to ensure effective BSA/AML model risk management for the Bank’s automated suspicious activity monitoring system, which must be validated by a qualified, independent third party; (vi) ensure that the Bank’s BSA Department maintains sufficient personnel; and (vii) develop revised policies and procedures to ensure effective controls over loan underwriting. In addition to these requirements, while the OCC Agreement remains in effect, the Bank is subject to certain restrictions on expansion activities, such as growth through acquisition or branching to supplement organic growth of the Bank. Further, any failure to comply with the requirements of the OCC Agreement could result in further enforcement actions, the imposition of material restrictions on the activities of the Bank, or the assessment of fines or penalties. The Bank established a Compliance Committee to monitor and assure compliance with the OCC Agreement, oversee the completion of an independent review of account and transaction activity to be conducted by a third party vendor, and engage a third party to conduct a model validation for its BSA/AML monitoring software. The Bank is fully cooperating with the OCC investigation and implementing the items necessary to achieve compliance with the obligations in the OCC Agreement. A finding by the OCC that the Bank failed to comply with the OCC Agreement or adverse findings in the OCC investigation could result in additional regulatory scrutiny, constraints on the Bank’s business, or other formal enforcement action. Any of those events could have a material adverse effect on our future operations, financial condition, growth, or other aspects of our business. The Bank has incurred significant costs in its efforts to comply with the OCC Agreement and respond to the OCC investigation, which are reflected in the Company’s results of operations for the nine months ended September 30, 2020. The Bank also has received grand jury subpoenas from the United States Department of Justice (the “DOJ”) beginning in 2020 requesting the production of documents and information in connection with an investigation that appears to be focused on the Bank’s residential lending practices and related issues. The Bank is fully cooperating with this ongoing investigation. Adverse findings in the DOJ investigation could result in material losses due to damages, penalties, costs, and/or expenses imposed on the Company, which could have a material adverse effect on our future operations, financial condition, growth, or other aspects of our business. The Bank expects to continue to incur significant costs in its efforts to comply with the DOJ investigation in 2020. In addition, the Company, certain of its current and former officers and directors, and other parties have been named as defendants in a shareholder class action captioned Oklahoma Police Pension and Retirement System v. Sterling Bancorp, Inc., et al. practices that were made in the Company’s registration statement and prospectus for its initial public offering, in subsequent press releases, in periodic and other filings with the SEC, and during earnings calls. The Company filed a motion to dismiss the amended complaint with the court on September 22, 2020. The Company intends to vigorously defend this and any related actions. On December 9, 2019, the Company announced it had voluntarily suspended its Advantage Loan Program in connection with an internal review of the program (the “Internal Review”). The primary focus of the Internal Review, which has been led by outside legal counsel under the direction of a special committee of independent directors (the “Special Committee”), has involved the origination of residential mortgage loans under the Advantage Loan Program and related matters. Results from the Special Committee’s Internal Review have indicated that certain employees engaged in misconduct in connection with the origination of a significant number of such loans, including with respect to verification of income, the amount of income reported for borrowers, reliance on third parties, and related documentation. As a result, the Company has permanently discontinued the Advantage Loan Program. While the Internal Review is substantially complete, the Company expects it to remain open during the pendency of the government investigations discussed herein, and it is possible additional work will be required in connection with the Internal Review. As of December 31, 2019, the Company established a liability of $25,000 for contingent losses based on additional information obtained during the course of the Internal Review and significant judgments by management. The Company has maintained the same level of liability for contingent losses at September 30, 2020. The outcome of the pending investigations and litigation is uncertain. There can be no assurance (i) that the Company will not incur material losses due to damages, penalties, costs and/or expenses as a result of such investigations and litigation, (ii) that the accrual for contingent losses will be sufficient to cover such losses, or (iii) that such losses will not materially exceed such accrual and have a material impact on the Company’s financial condition or results of operations. In addition, on July 28, 2020, the Company received a demand letter from two law firms representing a purported stockholder of the Company alleging facts and claims substantially the same as many of the alleged facts and claims in the class action lawsuit. The demand letter requests that the board of directors take action to (1) recover damages the Company has purportedly sustained as a result of alleged breaches of fiduciary duties by certain of its officers and directors; (2) recover for the benefit of the Company the amounts by which certain of its officers and directors purportedly were unjustly enriched; and (3) correct alleged deficiencies in the Company's internal controls. The demand letter states that, if the board of directors has not taken the actions demanded within 90 days after the receipt of the letter, or in the event the board of directors refuses to take the actions demanded, the purported stockholder will commence a stockholder derivative action on behalf of the Company seeking appropriate relief. The board of directors has established a demand review committee to evaluate the matters raised in the demand letter and to determine the actions, if any, that should be taken by the Company with respect to those matters. The Company has responded to the demand letter advising the purported shareholder of the appointment of the demand review committee. There can be no assurance as to whether any litigation will be commenced by or against the Company with respect to the claims set forth in the demand letter or that, if any such litigation is commenced, it will not have a material impact on our financial condition or results of operations. Mortgage Loan Repurchase Liability During the period 2015 through 2019, the Company sold portfolio loans originated under the Advantage Loan Program to private investors in the secondary market. The Company also sells conventional residential mortgage loans (which excludes Advantage Loan Program loans) in the secondary market primarily to Federal National Mortgage Association (“Fannie Mae”) on an ongoing basis. In connection with these loans sold, the Company makes customary representations and warranties about various characteristics of each loan. The Company may be required pursuant to the terms of the applicable mortgage loan purchase and sale agreements to repurchase any previously sold loan or indemnify (make whole) the investor for which the representation or warranty of the Company proves to be inaccurate, incomplete or misleading. In the event of a repurchase, the Company is typically required to pay the unpaid principal balance, the proportionate premium received when selling the loans and certain expenses. Historically, any repurchases due to a breach of any such representations and warranties have been de minimis. The Bank recorded a total mortgage repurchase liability of $7,197 and $7,823 at September 30, 2020 and December 31, 2019, respectively, primarily related to probable losses on the sold Advantage Loan Program loan portfolio taking into account the results of the Internal Review. The repurchase liability is included in accrued expenses and other liabilities in the condensed consolidated balance sheets. The unpaid principal balance of residential mortgage loans sold that were subject to potential repurchase obligations for breach of representations and warranties totaled $604,404 and $759,568 at September 31, 2020 and December 31, 2019, respectively, including Advantage Loan Program loans totaling $471,893 and $670,243 at September 30, 2020 and December 31, 2019, respectively. The repurchase liability reflects management’s estimate of losses based on a combination of factors. The Company’s estimation process requires management to make subjective and complex judgements about matters that are inherently uncertain, such as future repurchase demand expectations, economic factors, and findings from the Internal Review. The actual repurchase losses could vary significantly from the recorded repurchase liability, depending on the outcome of various factors, including those previously discussed. In May 2020, the Company negotiated the repurchases of two pools of Advantage Loan Program loans with a total outstanding unpaid principal balance of $38,704. These loans were previously sold to such third-party investors with servicing retained and were evaluated and considered to be performing at the acquisition date. In connection with these repurchases, the Company recognized a loss of $136 related to a fair value discount in other non-interest expense and a disposition of $428 of mortgage servicing rights. To avoid the uncertainty of audits and inquiries by third-party investors in the Advantage Loan Program, beginning at the end of the second quarter of 2020, the Company commenced making offers to each of those investors to repurchase 100% of sold Advantage Loan Program loans. ​ In July 2020, three third-party investors accepted the above mentioned offer, from which the Company repurchased three pools of Advantage Loan Program loans sold with a total outstanding unpaid principal balance of $19,251 . These loans were previously sold to such third-party investors with servicing retained and were evaluated and considered to be performing at the acquisition date. In connection with these repurchases, the Company recognized a loss of $135 related to fair value discount in other non-interest expense and a disposition of $203 of mortgage servicing rights, and charged a loss of $433 against the mortgage repurchase liability. In September 2020, an additional third-party investor accepted the above mentioned offer, from which the Company repurchased a pool of Advantage Loan Program loans sold with a total outstanding unpaid principal balance of $11,683 . These loans were previously sold to such third-party investor with servicing retained and were evaluated and considered to be performing at the acquisition date. In connection with this repurchase, the Company recognized a disposition of $158 of mortgage servicing rights and charged a loss of $218 against mortgage repurchase liability.

Subsequent Events

Subsequent Events	9 Months Ended
	Sep. 30, 2020
Subsequent Events
Subsequent Events	Note 17—Subsequent Events Sale of Quantum Capital Management On October 14, 2020, QCM, LLC, doing business as Quantum Capital Management, a wholly-owned subsidiary of Quantum Fund, LLC and an indirect wholly-owned subsidiary of the Bank (“Quantum Capital Management”), entered into an Asset Purchase Agreement to sell substantially all of its assets, which consist primarily of client advisory agreements. The closing of the transaction is subject to customary closing conditions, including third-party consents, and is expected to occur before year-end. In connection with the execution of the Asset Purchase Agreement, Mr. Peter Sinatra, a member of the boards of directors of the Company and of the Bank, as well as the CEO of Quantum Capital Management, notified the Company of his resignation from the Company's and the Bank's boards of directors, effective immediately, and from all other positions with Quantum Capital Management, the Company, the Bank, and each of their subsidiaries and affiliates, effective upon the closing of the transaction. Total revenue from Quantum Capital Management was $310 and $477 for the three months ended September 30, 2020 and 2019, respectively, and $878 and $1,242 for the nine months ended September 30, 2020 and 2019, respectively. The net loss from Quantum Capital Management before income taxes was $(69) and $(504) for the three months ended September 30, 2020 and 2019, respectively, and $(455) and $(1,943) for the nine months ended September 30, 2020 and 2019, respectively.

Summary of Significant Accoun_2

Summary of Significant Accounting Policies (Policies)	9 Months Ended
	Sep. 30, 2020
Summary of Significant Accounting Policies
Principles of Consolidation	Principles of Consolidation The accompanying condensed consolidated financial statements have been prepared in conformity with accounting principles generally accepted in the United States of America (“U.S. GAAP”). The condensed consolidated financial statements include the results of the Company and its wholly-owned subsidiary. All significant intercompany accounts and transactions have been eliminated in consolidation.
Use of Estimates	Use of Estimates The preparation of the condensed consolidated financial statements in conformity with U.S. GAAP requires management to make estimates and assumptions that affect the reported amounts of assets and liabilities and disclosure of contingent assets and liabilities at the date of the condensed consolidated financial statements and the reported amounts of revenues and expenses during the reporting period. Due to the inherent uncertainty involved in making estimates, actual results reported in the future periods may be based upon amounts that could differ from those estimates. During 2020, economies throughout the world have been severely disrupted because of the outbreak of the novel coronavirus (“COVID-19”). The Company’s primary market areas of California, the greater Seattle market, and New York became part of several epicenters of the COVID-19 pandemic. Banking and financial services have been designated essential businesses, and the Bank’s operations are continuing, subject to certain modifications to business practices imposed to safeguard the health and wellness of the Bank’s customers and employees, and to comply with applicable government directives. As of September 30, 2020, the impact of the outbreak of COVID-19 was continuing to unfold. As a result, many of management’s estimates and assumptions required increased judgement and carried a higher degree of variability and volatility. As events continue to evolve and additional information becomes available, management’s estimates may change materially in future periods.
Concentration of Credit Risk	Concentration of Credit Risk The loan portfolio consists primarily of residential real estate loans which are collateralized by real estate. At September 30, 2020 and December 31, 2019, residential real estate loans accounted for 82% and 85%, respectively, of the loan portfolio. In addition, most of these residential loans and other commercial loans have been made to individuals and businesses in the state of California which are dependent on the area economy for their livelihoods and servicing of their loan obligation. At September 30, 2020 and December 31, 2019, approximately 87% and 89%, respectively, of the loan portfolio was originated in California. Starting December 9, 2019, the Bank suspended its Advantage Loan Program and announced that it permanently discontinued this program on March 6, 2020. This Program was a material component of the Bank’s total loan originations. Loans under the Advantage Loan Program totaled $1,633,714, or 75% of the residential loan portfolio, as of September 30, 2020, and $1,942,657, or 78% of the residential loan portfolio, as of December 31, 2019.

Investment Securities (Tables)

Investment Securities (Tables)	9 Months Ended
	Sep. 30, 2020
Investment Securities
Schedule of amortized cost and fair value of debt securities available for sale	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ September 30, 2020 ​ ​ Amortized ​ Gross Unrealized ​ Fair ​ Cost Gain Loss Value Available for sale: ​ ​ ​ ​ U.S. Treasury & Agency securities ​ $ 94,990 ​ $ 398 ​ $ (13) ​ $ 95,375 Mortgage-backed securities ​ ​ 26,650 ​ ​ 95 ​ ​ — ​ ​ 26,745 Collateralized mortgage obligations ​ 120,091 ​ 600 ​ (489) ​ 120,202 Collateralized debt obligations ​ 214 ​ — ​ (30) ​ 184 Total ​ $ 241,945 ​ $ 1,093 ​ $ (532) ​ $ 242,506 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ December 31, 2019 ​ ​ Amortized ​ Gross Unrealized ​ Fair ​ Cost Gain Loss Value Available for sale: ​ ​ ​ ​ U.S. Treasury securities ​ $ 122,634 ​ $ 170 ​ $ (1) ​ $ 122,803 Mortgage-backed securities ​ ​ 23,028 ​ ​ 76 ​ ​ — ​ ​ 23,104 Collateralized mortgage obligations ​ 1,138 ​ 45 ​ — ​ 1,183 Collateralized debt obligations ​ 216 ​ — ​ (17) ​ 199 Total ​ $ 147,016 ​ $ 291 ​ $ (18) ​ $ 147,289
Schedule of amortized cost and fair value of debt securities available for sale, shown by contractual maturity	The amortized cost and fair value of debt securities available for sale issued by U.S. Treasury at September 30, 2020 are shown by contractual maturity. Mortgage-backed securities, collateralized mortgage obligations and collateralized debt obligations are disclosed separately in the table below as the expected maturities may differ from contractual maturities if borrowers have the right to call or prepay obligations with or without call or prepayment penalties. ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Amortized ​ Fair ​ Cost Value U.S. Treasury & Agency securities ​ ​ Due less than one year ​ $ 69,990 ​ $ 70,388 Due after one year through five years ​ ​ 25,000 ​ ​ 24,987 Mortgage-backed securities ​ ​ 26,650 ​ ​ 26,745 Collateralized mortgage obligations ​ 120,091 ​ 120,202 Collateralized debt obligations ​ 214 ​ 184 Total ​ $ 241,945 ​ $ 242,506
Schedule of debt securities available for sale, at fair value, continuous unrealized losses position	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ September 30, 2020 ​ ​ Less than 12 Months ​ 12 Months or More ​ Total ​ ​ Fair ​ Unrealized ​ Fair ​ Unrealized ​ Fair ​ Unrealized ​ Value Losses Value Losses Value Losses U.S. Treasury & Agency securities ​ $ 24,987 ​ $ (13) ​ $ — ​ $ — ​ $ 24,987 ​ $ (13) Collateralized mortgage obligations ​ ​ 65,450 ​ ​ (489) ​ ​ — ​ ​ — ​ ​ 65,450 ​ ​ (489) Collateralized debt obligations ​ — ​ ​ — ​ ​ 184 ​ ​ (30) ​ ​ 184 ​ ​ (30) Total ​ $ 90,437 ​ $ (502) ​ $ 184 ​ $ (30) ​ $ 90,621 ​ $ (532) ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ December 31, 2019 ​ ​ Less than 12 Months ​ 12 Months or More ​ Total ​ ​ Fair ​ Unrealized ​ Fair ​ Unrealized ​ Fair ​ Unrealized ​ Value Losses Value Losses Value Losses U.S. Treasury securities ​ $ 5,011 ​ $ (1) ​ $ — ​ $ — ​ $ 5,011 ​ $ (1) Collateralized debt obligations ​ — ​ — ​ 199 ​ (17) ​ 199 ​ (17) Total ​ $ 5,011 ​ $ (1) ​ $ 199 ​ $ (17) ​ $ 5,210 ​ $ (18)
Schedule of equity securities with readily determinable fair values	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Three Months Ended ​ Nine Months Ended ​ ​ September 30, ​ September 30, ​ 2020 2019 2020 2019 Net gains recorded during the period on equity securities ​ $ — ​ $ 30 ​ $ 123 ​ $ 136 Less: net gains recorded during the period on equity securities sold during the period ​ — ​ ​ — ​ — ​ ​ — Unrealized gains recorded during the period on equity securities held at the reporting date ​ $ — ​ $ 30 ​ $ 123 ​ $ 136

Loans (Tables)

Loans (Tables)	9 Months Ended
	Sep. 30, 2020
Loans
Schedule of major categories of loans	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ September 30, ​ December 31, ​ 2020 2019 Residential real estate ​ $ 2,183,546 ​ $ 2,476,866 Commercial real estate ​ 262,116 ​ 240,081 Construction ​ 211,460 ​ 178,376 Commercial lines of credit ​ 18,452 ​ 17,903 Other consumer ​ 8 ​ 34 Total loans ​ 2,675,582 ​ 2,913,260 Less: allowance for loan losses ​ (48,258) ​ (21,730) Loans, net ​ $ 2,627,324 ​ $ 2,891,530 ​
Schedule of activity in allowance for loan losses and recorded investment by portfolio segment	The table presents the activity in the allowance for loan losses by portfolio segment for the three and nine months ended September 30, 2020 and 2019: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Commercial ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential Commercial ​ Lines of Other ​ ​ ​ ​ Three Months Ended September 30, 2020 ​ Real Estate ​ Real Estate ​ Construction ​ Credit ​ Consumer ​ Unallocated ​ Total Allowance for loan losses: ​ ​ ​ ​ ​ ​ ​ Beginning balance ​ $ 18,812 ​ $ 15,770 ​ $ 11,998 ​ $ 350 ​ $ 1 ​ $ — ​ $ 46,931 Provision (recovery) for loan losses ​ (467) ​ 1,771 ​ 628 ​ 192 ​ (1) ​ — ​ 2,123 Charge offs ​ (108) ​ — ​ (707) ​ — ​ — ​ — ​ (815) Recoveries ​ 3 ​ 14 ​ 2 ​ — ​ — ​ — ​ 19 Total ending balance ​ $ 18,240 ​ $ 17,555 ​ $ 11,921 ​ $ 542 ​ $ — ​ $ — ​ $ 48,258 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Commercial ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential ​ Commercial ​ ​ ​ Lines of ​ Other ​ ​ ​ ​ ​ ​ Nine Months Ended September 30, 2020 Real Estate Real Estate Construction Credit Consumer Unallocated Total Allowance for loan losses: ​ ​ ​ ​ ​ ​ ​ Beginning balance ​ $ 12,336 ​ $ 5,243 ​ $ 3,822 ​ $ 328 ​ $ 1 ​ $ — ​ $ 21,730 Provision (recovery) for loan losses ​ 5,997 ​ 12,262 ​ 8,801 ​ 214 ​ (1) ​ — ​ 27,273 Charge offs ​ (108) ​ — ​ (707) ​ — ​ — ​ — ​ (815) Recoveries ​ 15 ​ 50 ​ 5 ​ — ​ — ​ — ​ 70 Total ending balance ​ $ 18,240 ​ $ 17,555 ​ $ 11,921 ​ $ 542 ​ $ — ​ $ — ​ $ 48,258 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Commercial ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential ​ Commercial ​ ​ ​ ​ Lines of ​ Other ​ ​ ​ ​ ​ ​ Three Months Ended September 30, 2019 Real Estate Real Estate Construction Credit Consumer Unallocated Total Allowance for loan losses: ​ ​ ​ ​ ​ ​ ​ Beginning balance ​ $ 12,758 ​ $ 3,214 ​ $ 3,067 ​ $ 780 ​ $ 1 ​ $ 1,098 ​ $ 20,918 Provision (recovery) for loan losses ​ (321) ​ 696 ​ 155 ​ (193) ​ — ​ (86) ​ 251 Charge offs ​ — ​ — ​ — ​ — ​ — ​ — ​ — Recoveries ​ 3 ​ 30 ​ 2 ​ — ​ — ​ — ​ 35 Total ending balance ​ $ 12,440 ​ $ 3,940 ​ $ 3,224 ​ $ 587 ​ $ 1 ​ $ 1,012 ​ $ 21,204 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Commercial ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential ​ Commercial ​ ​ ​ ​ Lines of ​ Other ​ ​ ​ ​ ​ ​ Nine Months Ended September 30, 2019 Real Estate Real Estate Construction Credit Consumer Unallocated Total Allowance for loan losses: ​ ​ ​ ​ ​ ​ ​ Beginning balance ​ $ 13,826 ​ $ 2,573 ​ $ 3,273 ​ $ 1,058 ​ $ 1 ​ $ 1,119 ​ $ 21,850 Provision (recovery) for loan losses ​ (1,402) ​ 1,275 ​ (54) ​ (295) ​ — ​ (107) ​ (583) Charge offs ​ — ​ — ​ — ​ (176) ​ — ​ — ​ (176) Recoveries ​ 16 ​ 92 ​ 5 ​ — ​ — ​ — ​ 113 Total ending balance ​ $ 12,440 ​ $ 3,940 ​ $ 3,224 ​ $ 587 ​ $ 1 ​ $ 1,012 ​ $ 21,204 ​ The following tables present the balance in the allowance for loan losses and the recorded investment by portfolio segment and based on impairment method as of September 30, 2020 and December 31, 2019: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Commercial ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential ​ Commercial ​ ​ ​ Lines of ​ Other ​ ​ ​ ​ ​ ​ September 30, 2020 Real Estate Real Estate Construction Credit Consumer Unallocated Total Allowance for loan losses: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Ending allowance balance attributable to loans: ​ ​ ​ ​ ​ ​ ​ ​ Individually evaluated for impairment ​ $ 41 ​ $ — ​ $ — ​ $ 4 ​ $ — ​ $ — ​ $ 45 Collectively evaluated for impairment ​ ​ 18,199 ​ ​ 17,555 ​ ​ 11,921 ​ ​ 538 ​ ​ — ​ ​ — ​ ​ 48,213 Total ending allowance balance ​ $ 18,240 ​ $ 17,555 ​ $ 11,921 ​ $ 542 ​ $ — ​ $ — ​ $ 48,258 Loans: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Loans individually evaluated for impairment ​ $ 211 ​ $ 14,153 ​ $ 46,214 ​ $ 1,244 ​ $ — ​ $ — ​ $ 61,822 Loans collectively evaluated for impairment ​ 2,183,335 ​ 247,963 ​ 165,246 ​ 17,208 ​ 8 ​ — ​ 2,613,760 Total ending loans balance ​ $ 2,183,546 ​ $ 262,116 ​ $ 211,460 ​ $ 18,452 ​ $ 8 ​ $ — ​ $ 2,675,582 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Commercial ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential ​ Commercial ​ ​ ​ Lines of ​ Other ​ ​ ​ ​ ​ ​ December 31, 2019 Real Estate Real Estate Construction Credit Consumer Unallocated Total Allowance for loan losses: ​ ​ ​ ​ ​ ​ ​ Ending allowance balance attributable to loans: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Individually evaluated for impairment ​ $ 43 ​ $ — ​ $ — ​ $ 5 ​ $ — ​ $ — ​ $ 48 Collectively evaluated for impairment ​ ​ 12,293 ​ ​ 5,243 ​ ​ 3,822 ​ ​ 323 ​ ​ 1 ​ ​ — ​ ​ 21,682 Total ending allowance balance ​ $ 12,336 ​ $ 5,243 ​ $ 3,822 ​ $ 328 ​ $ 1 ​ $ — ​ $ 21,730 Loans: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Loans individually evaluated for impairment ​ $ 215 ​ $ 1,100 ​ $ 17,112 ​ $ 1,377 ​ $ — ​ $ — ​ $ 19,804 Loans collectively evaluated for impairment ​ 2,476,651 ​ 238,981 ​ 161,264 ​ 16,526 ​ 34 ​ — ​ 2,893,456 Total ending loans balance ​ $ 2,476,866 ​ $ 240,081 ​ $ 178,376 ​ $ 17,903 ​ $ 34 ​ $ — ​ $ 2,913,260
Schedule of information related to impaired loans by class of loans	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ At September 30, 2020 ​ At December 31, 2019 ​ ​ Unpaid ​ ​ ​ ​ Allowance ​ Unpaid ​ ​ ​ ​ Allowance ​ ​ Principal ​ Recorded ​ for Loan ​ Principal ​ Recorded ​ for Loan ​ Balance Investment Losses Balance Investment Losses With no related allowance for loan losses recorded: ​ ​ ​ ​ ​ ​ ​ Residential real estate, first mortgage ​ $ 118 ​ $ 96 ​ $ — ​ $ 125 ​ $ 98 ​ $ — Commercial real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Retail ​ ​ 1,259 ​ ​ 1,040 ​ ​ — ​ ​ 1,308 ​ ​ 1,100 ​ ​ — Hotel/Single-room occupancy hotels ​ ​ 13,126 ​ ​ 13,113 ​ ​ — ​ ​ — ​ ​ — ​ ​ — Construction ​ ​ 46,945 ​ ​ 46,214 ​ ​ — ​ ​ 17,156 ​ ​ 17,112 ​ ​ — Commercial lines of credit: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Private banking ​ ​ — ​ ​ — ​ ​ — ​ ​ 1,245 ​ ​ 1,245 ​ ​ — C&I lending ​ ​ 1,117 ​ ​ 1,117 ​ ​ — ​ ​ — ​ ​ — ​ ​ — Subtotal ​ 62,565 ​ 61,580 ​ — ​ 19,834 ​ 19,555 ​ — With an allowance for loan losses recorded: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential real estate, first mortgage ​ 114 ​ 115 ​ 41 ​ 116 ​ 117 ​ 43 Commercial lines of credit, private banking ​ ​ 127 ​ ​ 127 ​ ​ 4 ​ ​ 132 ​ ​ 132 ​ ​ 5 Subtotal ​ 241 ​ 242 ​ 45 ​ 248 ​ 249 ​ 48 Total ​ $ 62,806 ​ $ 61,822 ​ $ 45 ​ $ 20,082 ​ $ 19,804 ​ $ 48 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Three Months Ended ​ ​ September 30, 2020 ​ September 30, 2019 ​ ​ Average ​ Interest ​ Cash Basis ​ Average ​ Interest ​ Cash Basis ​ ​ Recorded ​ Income ​ Interest ​ Recorded ​ Income ​ Interest ​ Investment Recognized Recognized Investment Recognized Recognized With no related allowance for loan losses recorded: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential real estate, first mortgage ​ $ 95 ​ $ — ​ $ — ​ $ 102 ​ $ — ​ $ — Commercial real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Retail ​ 1,050 ​ ​ 14 ​ ​ 10 ​ ​ 1,127 ​ ​ 16 ​ ​ 10 Hotel/Single-room occupancy hotels ​ ​ 13,090 ​ ​ — ​ ​ — ​ ​ — ​ ​ — ​ ​ — Construction ​ ​ 46,310 ​ ​ 221 ​ ​ 92 ​ ​ 6,492 ​ ​ 58 ​ ​ 52 Commercial lines of credit, C&I lending ​ ​ 1,151 ​ ​ — ​ ​ — ​ ​ 67 ​ ​ 1 ​ ​ 1 Subtotal ​ ​ 61,696 ​ ​ 235 ​ ​ 102 ​ 7,788 ​ 75 ​ 63 With an allowance for loan losses recorded: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential real estate, first mortgage ​ ​ 115 ​ ​ 1 ​ ​ 1 ​ 118 ​ 1 ​ 1 Commercial lines of credit, private banking ​ ​ 128 ​ ​ 2 ​ ​ 1 ​ ​ 135 ​ ​ 1 ​ ​ 1 Subtotal ​ ​ 243 ​ ​ 3 ​ ​ 2 ​ 253 ​ 2 ​ 2 Total ​ $ 61,939 ​ $ 238 ​ $ 104 ​ $ 8,041 ​ $ 77 ​ $ 65 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Nine Months Ended ​ ​ September 30, 2020 ​ September 30, 2019 ​ ​ Average ​ Interest ​ Cash Basis ​ Average ​ Interest ​ Cash Basis ​ ​ Recorded ​ Income ​ Interest ​ Recorded ​ Income ​ Interest ​ Investment Recognized Recognized Investment Recognized Recognized With no related allowance for loan losses recorded: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential real estate, first mortgage ​ $ 98 ​ $ — ​ $ — ​ $ 105 ​ $ — ​ $ — Commercial real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Retail ​ 1,079 ​ ​ 43 ​ ​ 39 ​ ​ 1,146 ​ ​ 46 ​ ​ 41 Multifamily ​ ​ — ​ ​ — ​ ​ — ​ ​ 598 ​ ​ 12 ​ ​ 12 Offices ​ ​ — ​ ​ — ​ ​ — ​ ​ 504 ​ ​ 25 ​ ​ 25 Hotel/Single-room occupancy hotels ​ ​ 13,085 ​ ​ — ​ ​ — ​ ​ — ​ ​ — ​ ​ — Construction ​ ​ 44,637 ​ ​ 1,031 ​ ​ 760 ​ ​ 8,274 ​ ​ 376 ​ ​ 370 Commercial lines of credit: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Private banking ​ ​ 934 ​ ​ 42 ​ ​ 35 ​ ​ — ​ ​ — ​ ​ — C&I lending ​ ​ 1,250 ​ ​ — ​ ​ — ​ ​ 89 ​ ​ 5 ​ ​ 5 Subtotal ​ ​ 61,083 ​ ​ 1,116 ​ ​ 834 ​ 10,716 ​ 464 ​ 453 With an allowance for loan losses recorded: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential real estate, first mortgage ​ ​ 116 ​ ​ 4 ​ ​ 3 ​ 119 ​ 4 ​ 3 Commercial lines of credit, Private banking ​ ​ 129 ​ ​ 5 ​ ​ 4 ​ ​ 137 ​ ​ 5 ​ ​ 5 Subtotal ​ ​ 245 ​ ​ 9 ​ ​ 7 ​ 256 ​ 9 ​ 8 Total ​ $ 61,328 ​ $ 1,125 ​ $ 841 ​ $ 10,972 ​ $ 473 ​ $ 461 ​
Schedule of recorded investment in nonaccrual and loans past due over 90 days still on accrual by class of loans and aging of the recorded investment in past due loans	The following table presents the recorded investment in nonaccrual and loans past due over 90 days still on accrual by class of loans as of September 30, 2020 and December 31, 2019: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ September 30, 2020 ​ December 31, 2019 ​ ​ ​ ​ ​ Loans Past ​ ​ ​ ​ Loans Past ​ ​ ​ ​ ​ Due Over ​ ​ ​ ​ Due Over ​ ​ ​ ​ ​ 90 Days Still ​ ​ ​ ​ 90 Days Still ​ Nonaccrual Accruing Nonaccrual Accruing Residential real estate: ​ ​ ​ ​ Residential first mortgage ​ $ 35,685 ​ $ 47 ​ $ 14,482 ​ $ 50 Residential second mortgage ​ ​ 688 ​ ​ — ​ ​ 210 ​ ​ — Commercial real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Retail ​ 25 ​ — ​ 40 ​ — Hotel/Single-room occupancy hotels ​ ​ 13,112 ​ ​ — ​ ​ — ​ ​ — Construction ​ ​ 32,488 ​ ​ — ​ ​ — ​ ​ — Commercial lines of credit: ​ ​ — ​ ​ ​ ​ ​ ​ ​ ​ ​ Private banking ​ ​ 1,117 ​ ​ — ​ ​ — ​ ​ — Total ​ $ 83,115 ​ $ 47 ​ $ 14,732 ​ $ 50 ​ The following tables present the aging of the recorded investment in past due loans as of September 30, 2020 and December 31, 2019 by class of loans: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Greater ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ 30 - 59 ​ 60 - 89 ​ than ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Days ​ Days ​ 89 Days ​ Total ​ Loans Not ​ ​ ​ September 30, 2020 Past Due Past Due Past Due Past Due Past Due Total Residential real estate: ​ ​ ​ ​ ​ ​ Residential first mortgage ​ $ 33,065 ​ $ 7,682 ​ $ 35,732 ​ $ 76,479 ​ $ 2,087,032 ​ $ 2,163,511 Residential second mortgage ​ 376 ​ — ​ 688 ​ 1,064 ​ 18,971 ​ 20,035 Commercial real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Retail ​ — ​ — ​ 25 ​ 25 ​ 17,705 ​ 17,730 Multifamily ​ — ​ — ​ — ​ — ​ 79,618 ​ 79,618 Offices ​ — ​ — ​ — ​ — ​ 27,381 ​ 27,381 Hotels/Single-room occupancy hotels ​ — ​ — ​ 13,112 ​ 13,112 ​ 59,875 ​ 72,987 Industrial ​ — ​ — ​ — ​ — ​ 13,323 ​ 13,323 Other ​ — ​ 1,194 ​ — ​ 1,194 ​ 49,883 ​ 51,077 Construction ​ ​ 7,146 ​ ​ 14,181 ​ ​ 32,488 ​ ​ 53,815 ​ ​ 157,645 ​ ​ 211,460 Commercial lines of credit: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Private banking ​ — ​ 1,170 ​ — ​ 1,170 ​ 2,411 ​ 3,581 C&I lending ​ — ​ — ​ 1,117 ​ 1,117 ​ 13,754 ​ 14,871 Other consumer ​ — ​ — ​ — ​ — ​ 8 ​ 8 Total ​ $ 40,587 ​ $ 24,227 ​ $ 83,162 ​ $ 147,976 ​ $ 2,527,606 ​ $ 2,675,582 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Greater ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ 30 - 59 ​ 60 - 89 ​ than ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Days ​ Days ​ 89 Days ​ Total ​ Loans Not ​ ​ ​ December 31, 2019 Past Due Past Due Past Due Past Due Past Due Total Residential real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential first mortgage ​ $ 36,112 ​ $ 5,112 ​ $ 14,532 ​ $ 55,756 ​ $ 2,396,800 ​ $ 2,452,556 Residential second mortgage ​ 97 ​ 295 ​ 210 ​ 602 ​ 23,708 ​ 24,310 Commercial real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Retail ​ — ​ — ​ 40 ​ 40 ​ 6,089 ​ 6,129 Multifamily ​ — ​ — ​ — ​ — ​ 64,873 ​ 64,873 Offices ​ — ​ — ​ — ​ — ​ 28,048 ​ 28,048 Hotel/Single-room occupancy hotels ​ 5,605 ​ — ​ — ​ 5,605 ​ 76,165 ​ 81,770 Industrial ​ — ​ — ​ — ​ — ​ 14,150 ​ 14,150 Other ​ — ​ — ​ — ​ — ​ 45,111 ​ 45,111 Construction ​ 15,008 ​ — ​ — ​ 15,008 ​ 163,368 ​ 178,376 Commercial lines of credit: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Private banking ​ — ​ — ​ — ​ — ​ 11,914 ​ 11,914 C&I lending ​ 1,249 ​ — ​ — ​ 1,249 ​ 4,740 ​ 5,989 Other consumer ​ — ​ — ​ — ​ — ​ 34 ​ 34 Total ​ $ 58,071 ​ $ 5,407 ​ $ 14,782 ​ $ 78,260 ​ $ 2,835,000 ​ $ 2,913,260 ​
Schedule of risk rating of loans by class of loans	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Special ​ ​ ​ ​ ​ ​ ​ ​ ​ September 30, 2020 Pass Mention Substandard Doubtful Total Residential real estate: ​ ​ ​ ​ ​ ​ Residential first mortgage ​ $ 2,127,778 ​ $ — ​ $ 35,637 ​ $ 96 ​ $ 2,163,511 Residential second mortgage ​ 19,347 ​ — ​ 688 ​ — ​ 20,035 Commercial real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Retail ​ 15,110 ​ 1,580 ​ 1,040 ​ — ​ 17,730 Multifamily ​ 58,679 ​ 12,596 ​ 8,343 ​ — ​ 79,618 Offices ​ 12,097 ​ 1,633 ​ 13,651 ​ — ​ 27,381 Hotels/Single-room occupancy hotels ​ 9,207 ​ 22,974 ​ 40,806 ​ — ​ 72,987 Industrial ​ 5,874 ​ — ​ 7,449 ​ — ​ 13,323 Other ​ 36,237 ​ 9,023 ​ 5,817 ​ — ​ 51,077 Construction ​ 152,261 ​ 25,882 ​ 33,317 ​ — ​ 211,460 Commercial lines of credit: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Private banking ​ 1,296 ​ 2,285 ​ — ​ — ​ 3,581 C&I lending ​ 13,754 ​ — ​ 1,117 ​ — ​ 14,871 Other consumer ​ 8 ​ — ​ — ​ — ​ 8 Total ​ $ 2,451,648 ​ $ 75,973 ​ $ 147,865 ​ $ 96 ​ $ 2,675,582 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Special ​ ​ ​ ​ ​ ​ ​ ​ ​ December 31, 2019 Pass Mention Substandard Doubtful Total Residential real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Residential first mortgage ​ $ 2,438,024 ​ $ — ​ $ 14,077 ​ $ 455 ​ $ 2,452,556 Residential second mortgage ​ 24,100 ​ — ​ 210 ​ — ​ 24,310 Commercial real estate: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Retail ​ 4,195 ​ 834 ​ 1,100 ​ — ​ 6,129 Multifamily ​ 56,164 ​ 7,150 ​ 1,559 ​ — ​ 64,873 Offices ​ 24,484 ​ 645 ​ 2,919 ​ — ​ 28,048 Hotels/Single-room occupancy hotels ​ 60,074 ​ 18,189 ​ 3,507 ​ — ​ 81,770 Industrial ​ 5,894 ​ 8,256 ​ — ​ — ​ 14,150 Other ​ 37,693 ​ 920 ​ 6,498 ​ — ​ 45,111 Construction ​ 156,339 ​ 7,008 ​ 15,029 ​ — ​ 178,376 Commercial lines of credit: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Private banking ​ 10,669 ​ 1,245 ​ — ​ — ​ 11,914 C&I lending ​ 4,013 ​ — ​ 1,976 ​ — ​ 5,989 Other consumer ​ 34 ​ — ​ — ​ — ​ 34 Total ​ $ 2,821,683 ​ $ 44,247 ​ $ 46,875 ​ $ 455 ​ $ 2,913,260

Mortgage Servicing Rights, net

Mortgage Servicing Rights, net (Tables)	9 Months Ended
	Sep. 30, 2020
Mortgage Servicing Rights, net
Schedule of principal balance of mortgage loans serviced for others	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ September 30, ​ December 31, ​ 2020 2019 Residential ​ ​ FNMA ​ $ 176,052 ​ $ 130,425 FHLB ​ 72,416 ​ 86,778 Private investors ​ 471,893 ​ 656,035 Total ​ $ 720,361 ​ $ 873,238
Schedule of activity for mortgage servicing rights and related valuation allowance	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Three Months Ended ​ Nine Months Ended ​ ​ September 30, ​ September 30, ​ 2020 2019 2020 2019 Mortgage servicing rights: ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Beginning of period ​ $ 9,569 ​ $ 11,073 ​ $ 10,845 ​ $ 10,733 Additions ​ ​ 119 ​ ​ 903 ​ 609 ​ 2,765 Amortization ​ ​ (1,123) ​ ​ (666) ​ (2,889) ​ (2,188) End of period ​ ​ 8,565 ​ ​ 11,310 ​ 8,565 ​ 11,310 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Valuation ​ ​ 2,303 ​ ​ 1,301 ​ 1,080 ​ 100 Additions (recoveries) ​ ​ (161) ​ ​ 99 ​ 1,062 ​ 1,300 Valuation allowance at end of period ​ ​ 2,142 ​ ​ 1,400 ​ 2,142 ​ 1,400 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Mortgage servicing rights, net ​ $ 6,423 ​ $ 9,910 ​ $ 6,423 ​ $ 9,910

FHLB Borrowings (Tables)

FHLB Borrowings (Tables)	9 Months Ended
	Sep. 30, 2020
FHLB Borrowings
Schedule of FHLB borrowings	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ September 30, ​ ​ ​ December 31, ​ ​ ​ 2020 Interest Rates 2019 Interest Rates Long-term fixed rate advances ​ $ 318,000 0.43% - 1.96% ​ $ 229,000 1.07% - 1.96% ​

Subordinated Notes, net (Tables

Subordinated Notes, net (Tables)	9 Months Ended
	Sep. 30, 2020
Subordinated Notes, net
Schedule of subordinated notes	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ September 30, ​ December 31, ​ 2020 2019 7.0% fixed to floating rate subordinated notes ​ $ 65,000 ​ $ 65,000 Unamortized note premium ​ 427 ​ 474 Unamortized debt issuance costs ​ (127) ​ (295) Total ​ $ 65,300 ​ $ 65,179 ​

Stock-based Compensation (Table

Stock-based Compensation (Tables)	9 Months Ended
	Sep. 30, 2020
Stock-based Compensation
Schedule of assumptions used to estimate grant date fair value of stock option awards using Black-Scholes option pricing model	​ ​ ​ ​ ​ ​ Exercise price of options $ 4.57 Risk-free interest rate ​ 0.49 % Expected term (in years) ​ 5.61 ​ Expected stock price volatility ​ 33.91 % Dividend yield ​ 0.10 % ​
Summary of the Company's stock option activity	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Weighted ​ ​ ​ ​ ​ ​ Weighted ​ Average ​ ​ ​ ​ ​ ​ Average ​ Remaining ​ Aggregate ​ ​ Number ​ Exercise ​ Contractual ​ Intrinsic ​ of Shares Price Term Value ​ ​ ​ ​ ​ ​ ​ (Years) ​ ​ Outstanding at January 1, 2020 ​ 142,477 $ 12.29 ​ 8.60 ​ $ — Granted ​ 367,361 ​ ​ 4.57 ​ ​ ​ ​ ​ Exercised ​ — ​ ​ — ​ ​ ​ ​ ​ Forfeited /expired ​ (112,018) ​ ​ 9.85 ​ ​ ​ ​ ​ Outstanding at September 30, 2020 ​ 397,820 $ 5.86 ​ 9.29 $ — ​
Summary of the Company's restricted stock awards activity	​ ​ ​ ​ ​ ​ ​ ​ ​ Weighted Average ​ ​ Number ​ Grant Date ​ ​ of Shares ​ Fair Value ​ ​ ​ ​ ​ ​ Nonvested at January 1, 2020 100,096 ​ $ 11.02 Granted 143,874 ​ 6.91 Vested (10,460) ​ 9.52 Forfeited (100,226) ​ 9.15 Nonvested at September 30, 2020 133,284 ​ $ 8.11

Income (Loss) Per Share (Tables

Income (Loss) Per Share (Tables)	9 Months Ended
	Sep. 30, 2020
Income (Loss) Per Share
Schedule of computation of income (loss) per share, basic and diluted	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Three Months Ended ​ Nine Months Ended ​ ​ September 30, ​ September 30, ​ 2020 2019 2020 2019 Numerator: ​ ​ ​ ​ Net income (loss) ​ $ (111) ​ $ 13,884 ​ $ (1,274) ​ $ 43,001 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Denominator: ​ ​ ​ ​ ​ ​ ​ ​ Weighted average common shares outstanding, basic ​ 49,843,925 ​ 50,428,108 ​ 49,839,860 ​ 51,490,046 Weighted average effect of potentially dilutive common shares: ​ ​ ​ ​ ​ ​ ​ ​ Stock options ​ — ​ — ​ — ​ — Restricted stock ​ — ​ 13,464 ​ — ​ 10,611 Weighted average common shares outstanding, diluted ​ 49,843,925 ​ 50,441,572 ​ 49,839,860 ​ 51,500,657 ​ ​ ​ ​ ​ ​ ​ ​ ​ Income (loss) per share ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Basic ​ $ (0.00) ​ $ 0.28 ​ $ (0.03) ​ $ 0.84 Diluted ​ $ (0.00) ​ $ 0.28 ​ $ (0.03) ​ $ 0.83
Schedule of anti-dilutive shares that were excluded from the computation of weighted average diluted shares outstanding	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Three Months Ended Nine Months Ended ​ ​ September 30, ​ September 30, ​ 2020 2019 2020 2019 Stock options 397,820 174,514 353,018 175,514 Restricted stock 133,284 — 177,016 38,235 Total 531,104 174,514 530,034 213,749

Fair Values of Financial Inst_2

Fair Values of Financial Instruments (Tables)	9 Months Ended
	Sep. 30, 2020
Fair Values of Financial Instruments
Schedule of assets measured at fair value on a recurring basis categorized by level of inputs	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Fair Value Measurements at ​ ​ September 30, 2020 ​ ​ ​ ​ ​ Quoted Prices ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ in Active ​ Significant ​ ​ ​ ​ ​ ​ ​ ​ Markets for ​ Other ​ Significant ​ ​ ​ ​ ​ Identical ​ Observable ​ Unobservable ​ ​ ​ ​ ​ Assets ​ Inputs ​ Inputs ​ Total (Level 1) (Level 2) (Level 3) Financial Assets ​ ​ ​ ​ Available for sale debt securities: ​ ​ ​ ​ U.S. Treasury & Agency securities ​ $ 95,375 ​ $ 45,371 ​ $ 50,004 ​ $ — Mortgage-backed securities ​ ​ 26,745 ​ ​ — ​ ​ 26,745 ​ ​ — Collateralized mortgage obligations ​ 120,202 ​ — ​ 120,202 ​ — Collateralized debt obligations ​ 184 ​ — ​ — ​ 184 Equity securities ​ 5,132 ​ 5,132 ​ — ​ — ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Fair Value Measurements at ​ ​ December 31, 2019 ​ ​ ​ ​ ​ Quoted Prices ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ in Active ​ Significant ​ ​ ​ ​ ​ ​ ​ ​ Markets for ​ Other ​ Significant ​ ​ ​ ​ ​ Identical ​ Observable ​ Unobservable ​ ​ ​ ​ ​ Assets ​ Inputs ​ Inputs ​ Total (Level 1) (Level 2) (Level 3) Financial Assets ​ ​ ​ ​ Available for sale debt securities: ​ ​ ​ ​ U.S. Treasury securities ​ $ 122,803 ​ $ 122,803 ​ $ — ​ $ — Mortgage-backed securities ​ ​ 23,104 ​ ​ — ​ ​ 23,104 ​ ​ — Collateralized mortgage obligations ​ 1,183 ​ — ​ 1,183 ​ — Collateralized debt obligations ​ 199 ​ — ​ — ​ 199 Equity securities ​ ​ 5,009 ​ ​ 5,009 ​ ​ — ​ ​ — ​
Summary of reconciliation for all assets measured at fair value on a recurring basis using significant unobservable inputs	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Fair Value Measurements Using Significant ​ ​ Unobservable Inputs (Level 3) ​ ​ Collateralized Debt Obligations ​ September 30, 2020 September 30, 2019 Balance of recurring Level 3 assets at beginning of period ​ $ 199 ​ $ 297 Total gains or losses (realized/unrealized): ​ ​ ​ Included in income-realized ​ — ​ — Included in other comprehensive income (loss) ​ (13) ​ (6) Principal maturities/settlements ​ ​ (2) ​ ​ (91) Sales ​ — ​ — Transfers in and/or out of Level 3 ​ — ​ — Balance of recurring Level 3 assets at end of period ​ $ 184 ​ $ 200 ​
Schedule of assets measured at fair value on a nonrecurring basis categorized by level of inputs	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Fair Value Measurements at September 30, 2020 ​ ​ ​ Quoted Prices in Significant ​ ​ ​ ​ ​ ​ ​ Active Markets ​ Other ​ Significant ​ ​ ​ ​ ​ for Identical ​ Observable ​ Unobservable ​ ​ ​ ​ Assets ​ Inputs ​ Inputs ​ ​ Fair Value ​ (Level 1) ​ (Level 2) ​ (Level 3) Mortgage servicing rights ​ $ 6,181 ​ $ — ​ $ — ​ $ 6,181 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Fair Value Measurements at December 31, 2019 ​ ​ ​ Quoted Prices in Significant ​ ​ ​ ​ ​ ​ ​ Active Markets ​ Other ​ Significant ​ ​ ​ ​ ​ for Identical ​ Observable ​ Unobservable ​ ​ ​ ​ Assets ​ Inputs ​ Inputs ​ ​ Fair Value ​ (Level 1) ​ (Level 2) ​ (Level 3) Mortgage servicing rights ​ $ 7,949 ​ $ — ​ $ — ​ $ 7,949
Schedule of quantitative information about nonrecurring Level 3 fair value measurements	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Quantitative Information about Level 3 Fair Value Measurements at September 30, 2020 ​ ​ ​ ​ ​ ​ ​ ​ ​ Range ​ Fair Value Valuation Technique Unobservable Inputs (Weighted Average) (1) Mortgage servicing rights ​ $ 6,181 ​ Discounted ​ Discount rate ​ 9.5% - 12.0% ​ ​ ​ Prepayment speed ​ 8.7% - 38.5% ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Default rate ​ 0.0% - 0.3% (1) The range and weighted average for an asset category consisting of a single investment represents the significant unobservable input used in the fair value of the investment. ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Quantitative Information about Level 3 Fair Value Measurements at December 31, 2019 ​ ​ ​ ​ ​ ​ ​ ​ ​ Range ​ Fair Value Valuation Technique Unobservable Inputs ​ (Weighted Average) (1) Mortgage servicing rights ​ $ 7,949 ​ Discounted cash flow ​ Discount rate ​ 9.5% - 12.0% ​ ​ ​ ​ ​ ​ ​ Prepayment speed ​ 7.2% - 47.1% ​ ​ ​ ​ ​ ​ ​ Default rate ​ 0.1% - 0.3% (1) The range and weighted average for an asset category consisting of a single investment represents the significant unobservable input used in the fair value of the investment.
Schedule of carrying amounts and estimated fair values of financial instruments not carried at fair value	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Fair Value Measurements at September 30, 2020 ​ ​ Carrying ​ Fair ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Amount Value Level 1 Level 2 Level 3 Financial Assets ​ ​ ​ ​ ​ ​ Cash and due from banks ​ $ 917,996 ​ $ 917,996 ​ $ 917,996 ​ $ — ​ $ — Interest-bearing time deposits with other banks ​ 7,988 ​ 8,011 ​ — ​ 8,011 ​ — Mortgage loans held for sale ​ 3,643 ​ 3,832 ​ — ​ 3,832 ​ — Loans, net ​ 2,627,324 ​ 2,680,289 ​ — ​ — ​ 2,680,289 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Financial Liabilities ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Time deposits ​ 1,687,883 ​ 1,699,441 ​ — ​ 1,699,441 ​ — Federal Home Loan Bank borrowings ​ 318,000 ​ 331,691 ​ — ​ 331,691 ​ — Subordinated notes, net ​ 65,300 ​ 66,312 ​ — ​ 66,312 ​ — ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Fair Value Measurements at December 31, 2019 ​ ​ Carrying ​ Fair ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Amount Value Level 1 Level 2 Level 3 Financial Assets ​ ​ ​ ​ ​ ​ Cash and due from banks ​ $ 77,819 ​ $ 77,819 ​ $ 77,819 ​ $ — ​ $ — Interest-bearing time deposits with other banks ​ 1,025 ​ 1,025 ​ 1,025 ​ — ​ — Mortgage loans held for sale ​ 1,337 ​ 1,368 ​ — ​ 1,368 ​ — Loans, net ​ 2,891,530 ​ 2,978,846 ​ — ​ — ​ 2,978,846 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Financial Liabilities ​ ​ ​ ​ ​ Time deposits ​ 1,154,076 ​ 1,161,490 ​ — ​ 1,161,490 ​ — Federal Home Loan Bank borrowings ​ 229,000 ​ 227,333 ​ — ​ 227,333 ​ — Subordinated notes, net ​ 65,179 ​ 65,650 ​ — ​ 65,650 ​ —

Regulatory Capital Requiremen_2

Regulatory Capital Requirements (Tables)	9 Months Ended
	Sep. 30, 2020
Regulatory Capital Requirements
Schedule of actual and minimum required capital amounts and ratios	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ For Capital ​ To be Well ​ ​ ​ Actual ​ Adequacy Purposes ​ Capitalized ​ Amount Ratio Amount Ratio Amount Ratio September 30, 2020 ​ ​ ​ ​ Total adjusted capital to risk-weighted assets ​ ​ ​ ​ Consolidated ​ $ 420,023 ​ 22.17 % $ 151,551 8.00 % ​ N/A N/A ​ Bank ​ 402,957 ​ 21.30 ​ 151,324 8.00 ​ $ 189,155 10.00 % Tier 1 (core) capital to risk-weighted assets ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Consolidated ​ 330,739 ​ 17.46 ​ 113,663 6.00 ​ N/A N/A ​ Bank ​ 379,009 ​ 20.03 ​ 113,493 6.00 ​ 151,324 8.00 ​ Common Equity Tier 1 (CET1) ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Consolidated ​ 330,739 ​ 17.46 ​ 85,247 4.50 ​ N/A N/A ​ Bank ​ 379,009 ​ 20.03 ​ 85,120 4.50 ​ 122,951 6.50 ​ Tier 1 (core) capital to adjusted tangible assets ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Consolidated ​ 330,739 ​ 8.64 ​ 153,223 4.00 ​ N/A N/A ​ Bank ​ 379,009 ​ 9.90 ​ 153,110 4.00 ​ 191,387 5.00 ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ For Capital ​ To be Well ​ ​ ​ Actual ​ Adequacy Purposes ​ Capitalized ​ Amount Ratio Amount Ratio Amount Ratio December 31, 2019 ​ ​ ​ ​ Total adjusted capital to risk-weighted assets ​ ​ ​ ​ Consolidated ​ $ 419,327 21.49 % $ 156,081 8.00 % ​ N/A N/A ​ Bank ​ 346,985 17.82 ​ 155,809 8.00 ​ $ 194,761 10.00 % Tier 1 (core) capital to risk-weighted assets ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Consolidated ​ 332,418 17.04 ​ 117,061 6.00 ​ N/A N/A ​ Bank ​ 325,255 16.70 ​ 116,857 6.00 ​ 155,809 8.00 ​ Common Equity Tier 1 (CET1) ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Consolidated ​ 332,418 17.04 ​ 87,796 4.50 ​ N/A N/A ​ Bank ​ 325,255 16.70 ​ 87,643 4.50 ​ 126,595 6.50 ​ Tier 1 (core) capital to adjusted tangible assets ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Consolidated ​ 332,418 10.11 ​ 131,471 4.00 ​ N/A N/A ​ Bank ​ 325,255 9.90 ​ 131,469 4.00 ​ 164,337 5.00 ​

Commitments and Contingencies (

Commitments and Contingencies (Tables)	9 Months Ended
	Sep. 30, 2020
Commitments and Contingencies
Summary of total amount of unfunded commitments to extend credit and standby letters of credit outstanding	​ ​ ​ ​ ​ ​ ​ ​ ​ ​ September 30, ​ December 31, ​ 2020 2019 Commitments to make loans ​ $ 50,193 ​ $ 76,927 Unused lines of credit ​ 184,517 ​ 220,553 Standby letters of credit ​ 24 ​ 24

Nature of Operations and Basi_2

Nature of Operations and Basis of Presentation (Details)	9 Months Ended
	Sep. 30, 2020itemsegment
Nature of Operations and Basis of Presentation
Number of branches	30
Number of reportable segments | segment	1
San Francisco and Los Angeles, California
Nature of Operations and Basis of Presentation
Number of branches	26

Summary of Significant Accoun_3

Summary of Significant Accounting Policies - Concentration of Credit Risk (Details) - USD ($) $ in Thousands	9 Months Ended	12 Months Ended
	Sep. 30, 2020	Dec. 31, 2019
Concentration of Credit Risk
Loans Receivable	$ 2,675,582	$ 2,913,260
Residential real estate
Concentration of Credit Risk
Loans Receivable	$ 2,183,546	$ 2,476,866
Residential real estate loans | Loans receivables
Concentration of Credit Risk
Concentration of credit risk	82.00%	85.00%
California | Loans receivables
Concentration of Credit Risk
Concentration of credit risk	87.00%	89.00%
Advantage loan program | Loans receivables | Residential real estate
Concentration of Credit Risk
Concentration of credit risk	75.00%	78.00%
Loans Receivable	$ 1,633,714	$ 1,942,657

Investment Securities - Amortiz

Investment Securities - Amortized Cost and Fair Value Corresponding Gross Unrealized Gains and Losses (Details) - USD ($) $ in Thousands	3 Months Ended	9 Months Ended	12 Months Ended
	Sep. 30, 2020	Sep. 30, 2020	Dec. 31, 2019
Available for sale:
Available for sale, Amortized Cost	$ 241,945	$ 241,945	$ 147,016
Available for sale, Gross Unrealized Gain	1,093	1,093	291
Available for sale, Gross Unrealized Loss	(532)	(532)	(18)
Investment securities available for sale, at fair value	242,506	242,506	147,289
Carrying value of debt securities held of any single issuer in excess of 10% of shareholders' equity	0	$ 0	$ 0
Threshold percentage of total shareholders' equity above which securities of any single issuer exceed		10.00%	10.00%
Sales of investment securities	40,612	$ 99,971
Gross realized gains	58	336
Gross realized losses	(78)	(157)
Securities pledged as collateral on FHLB borrowings	575,125	575,125	$ 933,747
Debt securities
Available for sale:
Securities pledged as collateral on FHLB borrowings	24,987	24,987
U.S. Treasury securities
Available for sale:
Available for sale, Amortized Cost			122,634
Available for sale, Gross Unrealized Gain			170
Available for sale, Gross Unrealized Loss			(1)
Investment securities available for sale, at fair value			122,803
U.S. Treasury & Agency securities
Available for sale:
Available for sale, Amortized Cost	94,990	94,990
Available for sale, Gross Unrealized Gain	398	398
Available for sale, Gross Unrealized Loss	(13)	(13)
Investment securities available for sale, at fair value	95,375	95,375
Mortgage-backed securities
Available for sale:
Available for sale, Amortized Cost	26,650	26,650	23,028
Available for sale, Gross Unrealized Gain	95	95	76
Investment securities available for sale, at fair value	26,745	26,745	23,104
Collateralized mortgage obligations
Available for sale:
Available for sale, Amortized Cost	120,091	120,091	1,138
Available for sale, Gross Unrealized Gain	600	600	45
Available for sale, Gross Unrealized Loss	(489)	(489)
Investment securities available for sale, at fair value	120,202	120,202	1,183
Collateralized debt obligations
Available for sale:
Available for sale, Amortized Cost	214	214	216
Available for sale, Gross Unrealized Loss	(30)	(30)	(17)
Investment securities available for sale, at fair value	$ 184	$ 184	$ 199

Investment Securities - Amort_2

Investment Securities - Amortized Cost and Fair Value By Contractual Maturity (Details) - USD ($) $ in Thousands	Sep. 30, 2020	Dec. 31, 2019
Available for sale, Amortized Cost
Available for sale, Amortized Cost	$ 241,945	$ 147,016
Available for sale, Fair Value
Available for sale, Fair Value	242,506	147,289
U.S. Treasury & Agency securities
Available for sale, Amortized Cost
Due less than one year	69,990
Due after one year through five years	25,000
Available for sale, Amortized Cost	94,990
Available for sale, Fair Value
Due less than one year	70,388
Due after one year through five years	24,987
Available for sale, Fair Value	95,375
Mortgage-backed securities
Available for sale, Amortized Cost
Available for sale, Amortized Cost	26,650	23,028
Available for sale, Fair Value
Available for sale, Fair Value	26,745	23,104
Collateralized mortgage obligations
Available for sale, Amortized Cost
Available for sale, Amortized Cost	120,091	1,138
Available for sale, Fair Value
Available for sale, Fair Value	120,202	1,183
Collateralized debt obligations
Available for sale, Amortized Cost
Available for sale, Amortized Cost	214	216
Available for sale, Fair Value
Available for sale, Fair Value	$ 184	$ 199

Investment Securities - Aggrega

Investment Securities - Aggregated by Major Security Type and Length of Time in a Continuous Unrealized Loss Position (Details) $ in Thousands	9 Months Ended
	Sep. 30, 2020USD ($)security	Dec. 31, 2019USD ($)
Fair Value
Less than 12 Months, Fair value	$ 90,437	$ 5,011
12 Months or More, Fair Value	184	199
Available for sale, Continuous unrealized loss position, Fair Value	90,621	5,210
Unrealized Losses
Less than 12 Months, Unrealized Losses	(502)	(1)
12 Months or More, Unrealized Losses	(30)	(17)
Available for sale, Continuous unrealized loss position, Unrealized Losses	$ (532)	(18)
Number of debt securities in portfolio | security	19
Number of debt securities in an unrealized loss position | security	8
U.S. Treasury securities
Fair Value
Less than 12 Months, Fair value		5,011
Available for sale, Continuous unrealized loss position, Fair Value		5,011
Unrealized Losses
Less than 12 Months, Unrealized Losses		(1)
Available for sale, Continuous unrealized loss position, Unrealized Losses		(1)
U.S. Treasury & Agency securities
Fair Value
Less than 12 Months, Fair value	$ 24,987
Available for sale, Continuous unrealized loss position, Fair Value	24,987
Unrealized Losses
Less than 12 Months, Unrealized Losses	(13)
Available for sale, Continuous unrealized loss position, Unrealized Losses	(13)
Collateralized mortgage obligations
Fair Value
Less than 12 Months, Fair value	65,450
Available for sale, Continuous unrealized loss position, Fair Value	65,450
Unrealized Losses
Less than 12 Months, Unrealized Losses	(489)
Available for sale, Continuous unrealized loss position, Unrealized Losses	(489)
Fair value of investments in unrealized loss position due to interest rate and prepayment fluctuations	64,910
Unrealized loss of investments, due to interest rate and prepayment fluctuations	467
Collateralized debt obligations
Fair Value
12 Months or More, Fair Value	184	199
Available for sale, Continuous unrealized loss position, Fair Value	184	199
Unrealized Losses
12 Months or More, Unrealized Losses	(30)	(17)
Available for sale, Continuous unrealized loss position, Unrealized Losses	$ (30)	$ (17)

Investment Securities - Equity

Investment Securities - Equity Securities (Details) - USD ($) $ in Thousands	3 Months Ended	9 Months Ended
	Sep. 30, 2019	Sep. 30, 2020	Sep. 30, 2019	Dec. 31, 2019
Equity Securities
Fair value of equity securities		$ 5,378		$ 5,255
Equity securities with readily determinable fair values		5,132		5,009
Equity securities with readily determinable fair values
Net gains recorded during the period on equity securities	$ 30	123	$ 136
Unrealized gains recorded during the period on equity securities held at the reporting date	$ 30	123	$ 136
Level 3
Equity Securities
Investment in equity securities without readily determinable fair value		$ 246		$ 246

Loans - Major Categories of Loa

Loans - Major Categories of Loans (Details) - USD ($) $ in Thousands	Sep. 30, 2020	Jun. 30, 2020	Dec. 31, 2019	Sep. 30, 2019	Jun. 30, 2019	Dec. 31, 2018
Major categories of loans
Total Loans	$ 2,675,582		$ 2,913,260
Less: allowance for loan losses	(48,258)	$ (46,931)	(21,730)	$ (21,204)	$ (20,918)	$ (21,850)
Loans, net	2,627,324		2,891,530
Carrying value of loans pledged as collateral on FHLB borrowings	575,125		933,747
Residential real estate
Major categories of loans
Total Loans	2,183,546		2,476,866
Less: allowance for loan losses	(18,240)	(18,812)	(12,336)	(12,440)	(12,758)	(13,826)
Loans, net	604,404		759,568
Commercial real estate
Major categories of loans
Total Loans	262,116		240,081
Less: allowance for loan losses	(17,555)	(15,770)	(5,243)	(3,940)	(3,214)	(2,573)
Construction
Major categories of loans
Total Loans	211,460		178,376
Less: allowance for loan losses	(11,921)	(11,998)	(3,822)	(3,224)	(3,067)	(3,273)
Commercial lines of credit
Major categories of loans
Total Loans	18,452		17,903
Less: allowance for loan losses	(542)	(350)	(328)	(587)	(780)	(1,058)
Other consumer
Major categories of loans
Total Loans	$ 8		34
Less: allowance for loan losses		$ (1)	$ (1)	$ (1)	$ (1)	$ (1)

Loans - Activity in the Allowan

Loans - Activity in the Allowance For Loan Losses by Portfolio Segment (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2020	Sep. 30, 2019	Sep. 30, 2020	Sep. 30, 2019
Allowance for loan losses
Beginning balance	$ 46,931	$ 20,918	$ 21,730	$ 21,850
Provision (recovery) for loan losses	2,123	251	27,273	(583)
Charge offs	(815)		(815)	(176)
Recoveries	19	35	70	113
Total ending balance	48,258	21,204	48,258	21,204
Residential real estate
Allowance for loan losses
Beginning balance	18,812	12,758	12,336	13,826
Provision (recovery) for loan losses	(467)	(321)	5,997	(1,402)
Charge offs	(108)		(108)
Recoveries	3	3	15	16
Total ending balance	18,240	12,440	18,240	12,440
Commercial real estate
Allowance for loan losses
Beginning balance	15,770	3,214	5,243	2,573
Provision (recovery) for loan losses	1,771	696	12,262	1,275
Recoveries	14	30	50	92
Total ending balance	17,555	3,940	17,555	3,940
Construction
Allowance for loan losses
Beginning balance	11,998	3,067	3,822	3,273
Provision (recovery) for loan losses	628	155	8,801	(54)
Charge offs	(707)		(707)
Recoveries	2	2	5	5
Total ending balance	11,921	3,224	11,921	3,224
Commercial lines of credit
Allowance for loan losses
Beginning balance	350	780	328	1,058
Provision (recovery) for loan losses	192	(193)	214	(295)
Charge offs				(176)
Total ending balance	542	587	542	587
Other consumer
Allowance for loan losses
Beginning balance	1	1	1	1
Provision (recovery) for loan losses	$ (1)		$ (1)
Total ending balance		1		1
Unallocated
Allowance for loan losses
Beginning balance		1,098		1,119
Provision (recovery) for loan losses		(86)		(107)
Total ending balance		$ 1,012		$ 1,012

Loans - Activity in the Allow_2

Loans - Activity in the Allowance For Loan Losses by Portfolio Segment And Based On Impairment Method (Details) - USD ($) $ in Thousands	Sep. 30, 2020	Jun. 30, 2020	Dec. 31, 2019	Sep. 30, 2019	Jun. 30, 2019	Dec. 31, 2018
Ending allowance balance attributable to loans:
Individually evaluated for impairment	$ 45		$ 48
Collectively evaluated for impairment	48,213		21,682
Total ending allowance balance	48,258	$ 46,931	21,730	$ 21,204	$ 20,918	$ 21,850
Loans:
Loans individually evaluated for impairment	61,822		19,804
Loans collectively evaluated for impairment	2,613,760		2,893,456
Total Loans	2,675,582		2,913,260
Residential real estate
Ending allowance balance attributable to loans:
Individually evaluated for impairment	41		43
Collectively evaluated for impairment	18,199		12,293
Total ending allowance balance	18,240	18,812	12,336	12,440	12,758	13,826
Loans:
Loans individually evaluated for impairment	211		215
Loans collectively evaluated for impairment	2,183,335		2,476,651
Total Loans	2,183,546		2,476,866
Commercial real estate
Ending allowance balance attributable to loans:
Collectively evaluated for impairment	17,555		5,243
Total ending allowance balance	17,555	15,770	5,243	3,940	3,214	2,573
Loans:
Loans individually evaluated for impairment	14,153		1,100
Loans collectively evaluated for impairment	247,963		238,981
Total Loans	262,116		240,081
Construction
Ending allowance balance attributable to loans:
Collectively evaluated for impairment	11,921		3,822
Total ending allowance balance	11,921	11,998	3,822	3,224	3,067	3,273
Loans:
Loans individually evaluated for impairment	46,214		17,112
Loans collectively evaluated for impairment	165,246		161,264
Total Loans	211,460		178,376
Commercial lines of credit
Ending allowance balance attributable to loans:
Individually evaluated for impairment	4		5
Collectively evaluated for impairment	538		323
Total ending allowance balance	542	350	328	587	780	1,058
Loans:
Loans individually evaluated for impairment	1,244		1,377
Loans collectively evaluated for impairment	17,208		16,526
Total Loans	18,452		17,903
Other consumer
Ending allowance balance attributable to loans:
Collectively evaluated for impairment			1
Total ending allowance balance		$ 1	1	1	1	1
Loans:
Loans collectively evaluated for impairment	8		34
Total Loans	$ 8		$ 34
Unallocated
Ending allowance balance attributable to loans:
Total ending allowance balance				$ 1,012	$ 1,098	$ 1,119

Loans - Impaired Loans by Class

Loans - Impaired Loans by Class of Loans (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2020	Sep. 30, 2019	Sep. 30, 2020	Sep. 30, 2019	Dec. 31, 2019
Impaired loans by class of loans
Unpaid principal balance, with no related allowance for loan losses recorded	$ 62,565		$ 62,565		$ 19,834
Unpaid principal balance, with an allowance for loan losses recorded	241		241		248
Total Unpaid Principal Balance	62,806		62,806		20,082
Recorded investment, with no related allowance for loan losses recorded	61,580		61,580		19,555
Recorded investment, with an allowance for loan losses recorded	242		242		249
Total Recorded Investment	61,822		61,822		19,804
Allowance for Loan Losses	45		45		48
Average recorded investment, with no related allowance for loan losses recorded	61,696	$ 7,788	61,083	$ 10,716
Average recorded investment, with an allowance for loan losses recorded	243	253	245	256
Total Average Recorded Investment	61,939	8,041	61,328	10,972
Interest Income Recognized, with no related allowance for loan losses recorded	235	75	1,116	464
Interest Income Recognized, with an allowance for loan losses recorded	3	2	9	9
Total Interest Income Recognized	238	77	1,125	473
Cash Basis Interest Recognized, with no related allowance for loan losses recorded	102	63	834	453
Cash Basis Interest Recognized, with an allowance for loan losses recorded	2	2	7	8
Total Cash Basis Interest Recognized	104	65	841	461
Residential real estate | Real estate loan, first mortgage
Impaired loans by class of loans
Unpaid principal balance, with no related allowance for loan losses recorded	118		118		125
Unpaid principal balance, with an allowance for loan losses recorded	114		114		116
Recorded investment, with no related allowance for loan losses recorded	96		96		98
Recorded investment, with an allowance for loan losses recorded	115		115		117
Allowance for Loan Losses	41		41		43
Average recorded investment, with no related allowance for loan losses recorded	95	102	98	105
Average recorded investment, with an allowance for loan losses recorded	115	118	116	119
Interest Income Recognized, with an allowance for loan losses recorded	1	1	4	4
Cash Basis Interest Recognized, with an allowance for loan losses recorded	1	1	3	3
Commercial real estate | Real estate loan, Retail
Impaired loans by class of loans
Unpaid principal balance, with no related allowance for loan losses recorded	1,259		1,259		1,308
Recorded investment, with no related allowance for loan losses recorded	1,040		1,040		1,100
Average recorded investment, with no related allowance for loan losses recorded	1,050	1,127	1,079	1,146
Interest Income Recognized, with no related allowance for loan losses recorded	14	16	43	46
Cash Basis Interest Recognized, with no related allowance for loan losses recorded	10	10	39	41
Commercial real estate | Real estate loan, Multifamily
Impaired loans by class of loans
Average recorded investment, with no related allowance for loan losses recorded				598
Interest Income Recognized, with no related allowance for loan losses recorded				12
Cash Basis Interest Recognized, with no related allowance for loan losses recorded				12
Commercial real estate | Real estate loan, Hotel/Single-room occupancy hotels
Impaired loans by class of loans
Unpaid principal balance, with no related allowance for loan losses recorded	13,126		13,126
Recorded investment, with no related allowance for loan losses recorded	13,113		13,113
Average recorded investment, with no related allowance for loan losses recorded	13,090		13,085
Commercial real estate | Real estate loan, Offices
Impaired loans by class of loans
Average recorded investment, with no related allowance for loan losses recorded				504
Interest Income Recognized, with no related allowance for loan losses recorded				25
Cash Basis Interest Recognized, with no related allowance for loan losses recorded				25
Construction
Impaired loans by class of loans
Unpaid principal balance, with no related allowance for loan losses recorded	46,945		46,945		17,156
Recorded investment, with no related allowance for loan losses recorded	46,214		46,214		17,112
Average recorded investment, with no related allowance for loan losses recorded	46,310	6,492	44,637	8,274
Interest Income Recognized, with no related allowance for loan losses recorded	221	58	1,031	376
Cash Basis Interest Recognized, with no related allowance for loan losses recorded	92	52	760	370
Commercial lines of credit | Private banking
Impaired loans by class of loans
Unpaid principal balance, with no related allowance for loan losses recorded					1,245
Unpaid principal balance, with an allowance for loan losses recorded	127		127		132
Recorded investment, with no related allowance for loan losses recorded					1,245
Recorded investment, with an allowance for loan losses recorded	127		127		132
Allowance for Loan Losses	4		4		$ 5
Average recorded investment, with no related allowance for loan losses recorded			934
Average recorded investment, with an allowance for loan losses recorded	128	135	129	137
Interest Income Recognized, with no related allowance for loan losses recorded			42
Interest Income Recognized, with an allowance for loan losses recorded	2	1	5	5
Cash Basis Interest Recognized, with no related allowance for loan losses recorded			35
Cash Basis Interest Recognized, with an allowance for loan losses recorded	1	1	4	5
Commercial lines of credit | C&I lending
Impaired loans by class of loans
Unpaid principal balance, with no related allowance for loan losses recorded	1,117		1,117
Recorded investment, with no related allowance for loan losses recorded	1,117		1,117
Average recorded investment, with no related allowance for loan losses recorded	$ 1,151	67	$ 1,250	89
Interest Income Recognized, with no related allowance for loan losses recorded		1		5
Cash Basis Interest Recognized, with no related allowance for loan losses recorded		$ 1		$ 5

Loans - Investment in Nonaccrua

Loans - Investment in Nonaccrual and Loans Past Due Still Accruing by Class of Loans (Details) - USD ($) $ in Thousands	Sep. 30, 2020	Dec. 31, 2019
Investment in nonaccrual and loans past due still accruing by class of loans
Nonaccrual	$ 83,115	$ 14,732
Loans Past Due Over 90 Days Still Accruing	47	50
Total Past Due	147,976	78,260
Loans Not Past Due	2,527,606	2,835,000
Total Loans	2,675,582	2,913,260
30 - 59 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due	40,587	58,071
60 - 89 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due	24,227	5,407
Greater than 89 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due	83,162	14,782
Residential real estate
Investment in nonaccrual and loans past due still accruing by class of loans
Total Loans	2,183,546	2,476,866
Residential real estate | Real estate loan, first mortgage
Investment in nonaccrual and loans past due still accruing by class of loans
Nonaccrual	35,685	14,482
Loans Past Due Over 90 Days Still Accruing	47	50
Total Past Due	76,479	55,756
Loans Not Past Due	2,087,032	2,396,800
Total Loans	2,163,511	2,452,556
Residential real estate | Real estate loan, first mortgage | 30 - 59 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due	33,065	36,112
Residential real estate | Real estate loan, first mortgage | 60 - 89 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due	7,682	5,112
Residential real estate | Real estate loan, first mortgage | Greater than 89 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due	35,732	14,532
Residential real estate | Real estate loan, second mortgage
Investment in nonaccrual and loans past due still accruing by class of loans
Nonaccrual	688	210
Total Past Due	1,064	602
Loans Not Past Due	18,971	23,708
Total Loans	20,035	24,310
Residential real estate | Real estate loan, second mortgage | 30 - 59 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due	376	97
Residential real estate | Real estate loan, second mortgage | 60 - 89 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due		295
Residential real estate | Real estate loan, second mortgage | Greater than 89 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due	688	210
Commercial real estate
Investment in nonaccrual and loans past due still accruing by class of loans
Total Loans	262,116	240,081
Commercial real estate | Real estate loan, Retail
Investment in nonaccrual and loans past due still accruing by class of loans
Nonaccrual	25	40
Total Past Due	25	40
Loans Not Past Due	17,705	6,089
Total Loans	17,730	6,129
Commercial real estate | Real estate loan, Retail | Greater than 89 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due	25	40
Commercial real estate | Real estate loan, Multifamily
Investment in nonaccrual and loans past due still accruing by class of loans
Loans Not Past Due	79,618	64,873
Total Loans	79,618	64,873
Commercial real estate | Real estate loan, Offices
Investment in nonaccrual and loans past due still accruing by class of loans
Loans Not Past Due	27,381	28,048
Total Loans	27,381	28,048
Commercial real estate | Real estate loan, Hotel/Single-room occupancy hotels
Investment in nonaccrual and loans past due still accruing by class of loans
Nonaccrual	13,112
Total Past Due	13,112	5,605
Loans Not Past Due	59,875	76,165
Total Loans	72,987	81,770
Commercial real estate | Real estate loan, Hotel/Single-room occupancy hotels | 30 - 59 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due		5,605
Commercial real estate | Real estate loan, Hotel/Single-room occupancy hotels | Greater than 89 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due	13,112
Commercial real estate | Real estate loan, Industrial
Investment in nonaccrual and loans past due still accruing by class of loans
Loans Not Past Due	13,323	14,150
Total Loans	13,323	14,150
Commercial real estate | Real estate loan, Other
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due	1,194
Loans Not Past Due	49,883	45,111
Total Loans	51,077	45,111
Commercial real estate | Real estate loan, Other | 60 - 89 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due	1,194
Construction
Investment in nonaccrual and loans past due still accruing by class of loans
Nonaccrual	32,488
Total Past Due	53,815	15,008
Loans Not Past Due	157,645	163,368
Total Loans	211,460	178,376
Construction | 30 - 59 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due	7,146	15,008
Construction | 60 - 89 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due	14,181
Construction | Greater than 89 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due	32,488
Commercial lines of credit
Investment in nonaccrual and loans past due still accruing by class of loans
Total Loans	18,452	17,903
Commercial lines of credit | Private banking
Investment in nonaccrual and loans past due still accruing by class of loans
Nonaccrual	1,117
Total Past Due	1,170
Loans Not Past Due	2,411	11,914
Total Loans	3,581	11,914
Commercial lines of credit | Private banking | 60 - 89 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due	1,170
Commercial lines of credit | C&I lending
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due	1,117	1,249
Loans Not Past Due	13,754	4,740
Total Loans	14,871	5,989
Commercial lines of credit | C&I lending | 30 - 59 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due		1,249
Commercial lines of credit | C&I lending | Greater than 89 Days Past Due
Investment in nonaccrual and loans past due still accruing by class of loans
Total Past Due	1,117
Other consumer
Investment in nonaccrual and loans past due still accruing by class of loans
Loans Not Past Due	8	34
Total Loans	$ 8	$ 34

Loans - Troubled Debt Restructu

Loans - Troubled Debt Restructurings (Details) $ in Thousands	9 Months Ended
	Sep. 30, 2020USD ($)loan	Dec. 31, 2019USD ($)
Troubled Debt Restructurings
Loans classified as troubled debt restructurings	$ 27,585	$ 13,708
Allowance for outstanding loan losses classified as troubled debt restructurings	45	48
Total outstanding recorded investment	1,046
Accrued interest receivable under the CARES Act COVID-19 forbearance program	$ 1,055
Loans that remain in payment deferral under the CARES Act COVID-19 forbearance program | loan	75
Aggregate loan balance of loans that remain in payment deferral under the CARES Act COVID-19 forbearance program	$ 54,413
Private banking
Troubled Debt Restructurings
Number of loans modified during the period, that were considered as TDRs | loan	1
Residential real estate
Troubled Debt Restructurings
Mortgage Loans in Process of Foreclosure, Amount	$ 13,962	$ 1,643
Construction
Troubled Debt Restructurings
Number of TDRs subsequently defaulted | loan	4
Value of troubled debt restructurings subsequently defaulted	$ 12,482
Number of loans modified during the period, that were considered as TDRs | loan	3
Construction loans and private banking loan | Pre and Post Modification
Troubled Debt Restructurings
Loans classified as troubled debt restructurings	$ 13,777

Loans - Risk Rating of Loans by

Loans - Risk Rating of Loans by Class of Loans (Details) - USD ($) $ in Thousands	1 Months Ended			3 Months Ended		9 Months Ended
	Sep. 30, 2020	Jul. 31, 2020	May 31, 2020	Sep. 30, 2020	Sep. 30, 2019	Sep. 30, 2020	Sep. 30, 2019	Dec. 31, 2019
Recorded investment in loans
Total	$ 2,675,582			$ 2,675,582		$ 2,675,582		$ 2,913,260
Portfolio loans sold during the period					$ 51,591		$ 173,397
Gain on sale of portfolio loans					1,683		5,985
Unpaid principal balance	2,627,324			2,627,324		2,627,324		2,891,530
Other Noninterest Expense				1,612	$ 1,831	4,611	$ 5,656
Advantage Loan Program
Recorded investment in loans
Outstanding principal balance of loans repurchased	11,683	$ 19,251	$ 38,704	30,934		69,638
Unpaid principal balance	471,893			471,893		471,893		670,243
Other Noninterest Expense		$ 135	$ 136	135		271
Pass
Recorded investment in loans
Total	2,451,648			2,451,648		2,451,648		2,821,683
Special Mention
Recorded investment in loans
Total	75,973			75,973		75,973		44,247
Substandard
Recorded investment in loans
Total	147,865			147,865		147,865		46,875
Doubtful
Recorded investment in loans
Total	96			96		96		455
Residential real estate
Recorded investment in loans
Total	2,183,546			2,183,546		2,183,546		2,476,866
Unpaid principal balance	604,404			604,404		604,404		759,568
Residential real estate | Real estate loan, first mortgage
Recorded investment in loans
Total	2,163,511			2,163,511		2,163,511		2,452,556
Residential real estate | Real estate loan, second mortgage
Recorded investment in loans
Total	20,035			20,035		20,035		24,310
Residential real estate | Pass | Real estate loan, first mortgage
Recorded investment in loans
Total	2,127,778			2,127,778		2,127,778		2,438,024
Residential real estate | Pass | Real estate loan, second mortgage
Recorded investment in loans
Total	19,347			19,347		19,347		24,100
Residential real estate | Substandard | Real estate loan, first mortgage
Recorded investment in loans
Total	35,637			35,637		35,637		14,077
Residential real estate | Substandard | Real estate loan, second mortgage
Recorded investment in loans
Total	688			688		688		210
Residential real estate | Doubtful | Real estate loan, first mortgage
Recorded investment in loans
Total	96			96		96		455
Commercial real estate
Recorded investment in loans
Total	262,116			262,116		262,116		240,081
Commercial real estate | Real estate loan, Retail
Recorded investment in loans
Total	17,730			17,730		17,730		6,129
Commercial real estate | Real estate loan, Multifamily
Recorded investment in loans
Total	79,618			79,618		79,618		64,873
Commercial real estate | Real estate loan, Offices
Recorded investment in loans
Total	27,381			27,381		27,381		28,048
Commercial real estate | Real estate loan, Hotel/Single-room occupancy hotels
Recorded investment in loans
Total	72,987			72,987		72,987		81,770
Commercial real estate | Real estate loan, Industrial
Recorded investment in loans
Total	13,323			13,323		13,323		14,150
Commercial real estate | Real estate loan, Other
Recorded investment in loans
Total	51,077			51,077		51,077		45,111
Commercial real estate | Pass | Real estate loan, Retail
Recorded investment in loans
Total	15,110			15,110		15,110		4,195
Commercial real estate | Pass | Real estate loan, Multifamily
Recorded investment in loans
Total	58,679			58,679		58,679		56,164
Commercial real estate | Pass | Real estate loan, Offices
Recorded investment in loans
Total	12,097			12,097		12,097		24,484
Commercial real estate | Pass | Real estate loan, Hotel/Single-room occupancy hotels
Recorded investment in loans
Total	9,207			9,207		9,207		60,074
Commercial real estate | Pass | Real estate loan, Industrial
Recorded investment in loans
Total	5,874			5,874		5,874		5,894
Commercial real estate | Pass | Real estate loan, Other
Recorded investment in loans
Total	36,237			36,237		36,237		37,693
Commercial real estate | Special Mention | Real estate loan, Retail
Recorded investment in loans
Total	1,580			1,580		1,580		834
Commercial real estate | Special Mention | Real estate loan, Multifamily
Recorded investment in loans
Total	12,596			12,596		12,596		7,150
Commercial real estate | Special Mention | Real estate loan, Offices
Recorded investment in loans
Total	1,633			1,633		1,633		645
Commercial real estate | Special Mention | Real estate loan, Hotel/Single-room occupancy hotels
Recorded investment in loans
Total	22,974			22,974		22,974		18,189
Commercial real estate | Special Mention | Real estate loan, Industrial
Recorded investment in loans
Total								8,256
Commercial real estate | Special Mention | Real estate loan, Other
Recorded investment in loans
Total	9,023			9,023		9,023		920
Commercial real estate | Substandard | Real estate loan, Retail
Recorded investment in loans
Total	1,040			1,040		1,040		1,100
Commercial real estate | Substandard | Real estate loan, Multifamily
Recorded investment in loans
Total	8,343			8,343		8,343		1,559
Commercial real estate | Substandard | Real estate loan, Offices
Recorded investment in loans
Total	13,651			13,651		13,651		2,919
Commercial real estate | Substandard | Real estate loan, Hotel/Single-room occupancy hotels
Recorded investment in loans
Total	40,806			40,806		40,806		3,507
Commercial real estate | Substandard | Real estate loan, Industrial
Recorded investment in loans
Total	7,449			7,449		7,449
Commercial real estate | Substandard | Real estate loan, Other
Recorded investment in loans
Total	5,817			5,817		5,817		6,498
Construction
Recorded investment in loans
Total	211,460			211,460		211,460		178,376
Construction | Pass
Recorded investment in loans
Total	152,261			152,261		152,261		156,339
Construction | Special Mention
Recorded investment in loans
Total	25,882			25,882		25,882		7,008
Construction | Substandard
Recorded investment in loans
Total	33,317			33,317		33,317		15,029
Commercial lines of credit
Recorded investment in loans
Total	18,452			18,452		18,452		17,903
Commercial lines of credit | Private banking
Recorded investment in loans
Total	3,581			3,581		3,581		11,914
Commercial lines of credit | C&I lending
Recorded investment in loans
Total	14,871			14,871		14,871		5,989
Commercial lines of credit | Pass | Private banking
Recorded investment in loans
Total	1,296			1,296		1,296		10,669
Commercial lines of credit | Pass | C&I lending
Recorded investment in loans
Total	13,754			13,754		13,754		4,013
Commercial lines of credit | Special Mention | Private banking
Recorded investment in loans
Total	2,285			2,285		2,285		1,245
Commercial lines of credit | Substandard | C&I lending
Recorded investment in loans
Total	1,117			1,117		1,117		1,976
Other consumer
Recorded investment in loans
Total	8			8		8		34
Other consumer | Pass
Recorded investment in loans
Total	$ 8			$ 8		$ 8		$ 34

Mortgage Servicing Rights, ne_2

Mortgage Servicing Rights, net - Principle Balance by Category (Details) - USD ($) $ in Thousands	Sep. 30, 2020	Dec. 31, 2019
Mortgage Servicing Rights
Total	$ 720,361	$ 873,238
Custodial escrow balances maintained on serviced loans	9,583	7,688
FNMA
Mortgage Servicing Rights
Total	176,052	130,425
FHLB
Mortgage Servicing Rights
Total	72,416	86,778
Private investors
Mortgage Servicing Rights
Total	$ 471,893	$ 656,035

Mortgage Servicing Rights, ne_3

Mortgage Servicing Rights, net - Activity and Related Valuation Allowance (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2020	Sep. 30, 2019	Sep. 30, 2020	Sep. 30, 2019	Dec. 31, 2019
Mortgage servicing rights activity
Mortgage servicing rights Beginning of period	$ 9,569	$ 11,073	$ 10,845	$ 10,733
Additions	119	903	609	2,765
Amortization	(1,123)	(666)	(2,889)	(2,188)
Mortgage servicing rights End of period	8,565	11,310	8,565	11,310
Valuation allowance at beginning of period	2,303	1,301	1,080	100
Additions (recoveries)	(161)	99	1,062	1,300
Valuation allowance at end of period	2,142	1,400	2,142	1,400
Mortgage servicing rights, net	6,423	9,910	6,423	9,910	$ 9,765
Servicing fee income, net of amortization of servicing rights and changes in valuation allowance	$ (121)	$ 240	$ (1,239)	$ (437)

Mortgage Servicing Rights, ne_4

Mortgage Servicing Rights, net - Valuation techniques (Details) - USD ($) $ in Thousands	9 Months Ended	12 Months Ended
	Sep. 30, 2020	Dec. 31, 2019
Mortgage Servicing Rights
Fair value of mortgage servicing rights	$ 6,603	$ 10,271
Weighted average default rate	0.20%	0.20%
Minimum
Mortgage Servicing Rights
Discount rate range	9.50%	9.50%
Prepayment speed range	6.80%	6.80%
Maximum
Mortgage Servicing Rights
Discount rate range	12.00%	12.00%
Prepayment speed range	38.50%	47.10%

Deposits - Time deposits (Detai

Deposits - Time deposits (Details) - USD ($) $ in Thousands	Sep. 30, 2020	Dec. 31, 2019
Deposits
Interest-bearing time deposits	$ 1,687,883	$ 1,154,076
Brokered time deposits	42,751	25,000
Time deposits that meet or exceed the FDIC insurance limit of $250	$ 498,264	$ 283,457

FHLB Borrowings (Details)

FHLB Borrowings (Details) - USD ($) $ in Thousands	Sep. 30, 2020	Dec. 31, 2019
Federal Home Loan Bank Borrowings
Long-term fixed rate advances	$ 318,000	$ 229,000
Additional borrowing capacity	$ 44,523
Minimum | Long term
Federal Home Loan Bank Borrowings
FHLB interest rates (as a percent)	0.43%	1.07%
Maximum | Long term
Federal Home Loan Bank Borrowings
FHLB interest rates (as a percent)	1.96%	1.96%

FHLB Borrowings - FHLB Advances

FHLB Borrowings - FHLB Advances (Details) $ in Thousands	Sep. 30, 2020USD ($)
Federal Home Loan Bank Borrowings
Additional borrowing capacity	$ 44,523
Callable Option
Federal Home Loan Bank Borrowings
Total FHLB advances	307,000
Callable Option November, 2020
Federal Home Loan Bank Borrowings
Total FHLB advances	100,000
Callable Option September, 2021
Federal Home Loan Bank Borrowings
Total FHLB advances	67,000
Callable Option October, 2021
Federal Home Loan Bank Borrowings
Total FHLB advances	90,000
Callable Option May, 2024
Federal Home Loan Bank Borrowings
Total FHLB advances	$ 50,000

FHLB Borrowings - FHLB Overdraf

FHLB Borrowings - FHLB Overdraft Line of Credit (Details) - USD ($) $ in Thousands	9 Months Ended
	Sep. 30, 2020	Sep. 30, 2019	Dec. 31, 2019
FHLB Borrowings
FHLB line of credit agreement maximum borrowing limit	$ 50,000
FHLB overdraft line of credit average borrowings outstanding	$ 24	$ 2,566
FHLB overdraft line of credit (as percent)	0.50%		1.99%
FHLB, agreement term	1 year
Carrying value of loans pledged as collateral on FHLB borrowings	$ 575,125		$ 933,747

FHLB Borrowings - Other Borrowi

FHLB Borrowings - Other Borrowings (Details) - Other Banks - USD ($) $ in Thousands	Sep. 30, 2020	Dec. 31, 2019
Other Borrowings
Maximum borrowing capacity	$ 100,000	$ 70,000
Outstanding balance	$ 0	$ 0

Subordinated Notes, net (Detail

Subordinated Notes, net (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended		12 Months Ended
	Sep. 30, 2020	Sep. 30, 2019	Sep. 30, 2020	Sep. 30, 2019	Dec. 31, 2019
Subordinated Notes
Total	$ 65,300		$ 65,300		$ 65,179
Interest expense	1,178	$ 1,175	3,533	$ 3,524
Subordinated notes
Subordinated Notes
7.0% fixed to floating rate subordinated notes	65,000		65,000		65,000
Unamortized note premium	427		427		474
Unamortized debt issuance costs	(127)		(127)		(295)
Total	65,300		$ 65,300		$ 65,179
Interest rate (as a percent)			7.00%		7.00%
Interest expense	$ 1,178	$ 1,175	$ 3,533	$ 3,524
Redemption price percentage of outstanding principal amount			100.00%
LIBOR | Subordinated notes
Subordinated Notes
Variable interest rate on subordinate notes (in percent)			5.82%

Stock Repurchase Program (Detai

Stock Repurchase Program (Details) - USD ($) $ / shares in Units, $ in Thousands	3 Months Ended				9 Months Ended
	Mar. 31, 2020	Sep. 30, 2019	Jun. 30, 2019	Mar. 31, 2019	Sep. 30, 2020	Dec. 31, 2018
Stock Repurchase Program
Shares repurchased and cancelled, value	$ 82	$ 4,168	$ 10,011	$ 11,544
Common stock
Stock Repurchase Program
Shares repurchased and canceled	10,912	421,581	1,034,792	1,212,574	10,912
Shares repurchased and cancelled, value	$ 82	$ 4,168	$ 10,011	$ 11,544	$ 82
Average repurchase price (in dollars per share)					$ 7.57
Common stock repurchases remaining value					$ 19,568
Maximum | Common stock
Stock Repurchase Program
Stock repurchase program authorized amount						$ 50,000

Stock-based Compensation (Detai

Stock-based Compensation (Details) - USD ($) $ / shares in Units, $ in Thousands	Sep. 22, 2020	Sep. 05, 2020	Jun. 05, 2020	Mar. 02, 2020	Sep. 30, 2020	Sep. 30, 2019	Sep. 30, 2020	Sep. 30, 2019	Dec. 31, 2019
Stock Options | Thomas M. O'Brien
Stock-based Compensation
Maximum term of stock awards granted		10 years
Exercise price			$ 4
Number of awards granted			300,000
Exercisable period of awards post termination of employment		3 years
Number of Shares
Granted			300,000
Weighted Average Exercise Price
Granted			$ 4
Stock Options | Awards vesting on January 1, 2021 | Thomas M. O'Brien
Stock-based Compensation
Percentage of awards vesting			33.00%
Stock Options | Awards vesting on first anniversary of the date of grant | Thomas M. O'Brien
Stock-based Compensation
Percentage of awards vesting			33.00%
Stock Options | Awards vesting on January 1, 2022 | Thomas M. O'Brien
Stock-based Compensation
Percentage of awards vesting			33.00%
2017 Omnibus Equity Incentive Plan
Stock-based Compensation
Number of shares authorized					4,237,100		4,237,100
2017 Omnibus Equity Incentive Plan | Stock Options
Stock-based Compensation
Maximum term of stock awards granted							10 years
Number of share instruments issued				67,361
Exercise price				$ 7.10			$ 4.57
Weighted average grant-date fair value				1.78
Number of awards granted							367,361
Fair value assumptions used in Black-Scholes option pricing model
Exercise price of options					$ 4.57		$ 4.57
Risk-free interest rate							0.49%
Expected term (in years)							5 years 7 months 9 days
Expected stock price volatility							33.91%
Dividend yield							0.10%
Number of Shares
Outstanding at January 1, 2020							142,477
Granted							367,361
Forfeited/expired							(112,018)
Outstanding at September 30, 2020					397,820		397,820		142,477
Weighted Average Exercise Price
Outstanding at January 1, 2020							$ 12.29
Granted				$ 7.10			4.57
Forfeited/expired							9.85
Outstanding at September 30, 2020					$ 5.86		$ 5.86		$ 12.29
Weighted Average Remaining Contractual Term
Weighted Average Remaining Contractual Term (Years)							9 years 3 months 14 days		8 years 7 months 6 days
Stock-based compensation costs recognized					$ 57	$ 43	$ 112	$ 114
Total unrecognized compensation cost - stock options					$ 389		$ 389
Unrecognized compensation cost related to nonvested awards, expected to be recognized over a weighted-average period							1 year 3 months
Number of options exercisable					0		0
2017 Omnibus Equity Incentive Plan | Stock Options granted prior to 2020 | Awards vesting at the end of the third year
Stock-based Compensation
Percentage of awards vesting							50.00%
2017 Omnibus Equity Incentive Plan | Stock Options granted prior to 2020 | Awards vesting at the end of the fourth year
Stock-based Compensation
Percentage of awards vesting							50.00%
2017 Omnibus Equity Incentive Plan | Stock Options granted starting in 2020
Stock-based Compensation
Vesting period							3 years
2017 Omnibus Equity Incentive Plan | Stock Options granted starting in 2020 | Awards vesting on the first anniversary of the grant date
Stock-based Compensation
Percentage of awards vesting							33.00%
2017 Omnibus Equity Incentive Plan | Stock Options granted starting in 2020 | Awards vesting at the end of the second year
Stock-based Compensation
Percentage of awards vesting							33.00%
2017 Omnibus Equity Incentive Plan | Stock Options granted starting in 2020 | Awards vesting at the end of the third year
Stock-based Compensation
Percentage of awards vesting							33.00%
2017 Omnibus Equity Incentive Plan | Restricted Stock
Weighted Average Remaining Contractual Term
Stock-based compensation costs recognized					$ 1	$ 103	$ 64	$ 311
Total unrecognized compensation cost - restricted stock awards					$ 750		$ 750
Unrecognized compensation cost related to nonvested awards, expected to be recognized over a weighted-average period							2 years 4 months 9 days
Number of Shares
Nonvested at January 1, 2020							100,096
Granted							143,874
Vested							(10,460)
Forfeited							(100,226)
Nonvested at June 30, 2020					133,284		133,284		100,096
Weighted Average Grant Date Fair Value
Nonvested at January 1, 2020							$ 11.02
Granted							6.91
Vested							9.52
Forfeited							9.15
Nonvested at September 30, 2020					$ 8.11		$ 8.11		$ 11.02
2017 Omnibus Equity Incentive Plan | Restricted Stock | Key employee
Stock-based Compensation
Vesting period				3 years
Number of share instruments issued	2,500			141,374
2017 Omnibus Equity Incentive Plan | Restricted Stock | Key employee | Awards vesting on the first anniversary of the grant date
Stock-based Compensation
Percentage of awards vesting				33.00%
2017 Omnibus Equity Incentive Plan | Restricted Stock | Key employee | Awards vesting at the end of the second year
Stock-based Compensation
Percentage of awards vesting				33.00%
2017 Omnibus Equity Incentive Plan | Restricted Stock | Key employee | Awards vesting at the end of the third year
Stock-based Compensation
Percentage of awards vesting				33.00%

Income (Loss) Per Share (Detail

Income (Loss) Per Share (Details) - USD ($) $ / shares in Units, $ in Thousands	3 Months Ended						9 Months Ended
	Sep. 30, 2020	Jun. 30, 2020	Mar. 31, 2020	Sep. 30, 2019	Jun. 30, 2019	Mar. 31, 2019	Sep. 30, 2020	Sep. 30, 2019
Numerator:
Net income (loss)	$ (111)	$ 2,867	$ (4,030)	$ 13,884	$ 13,434	$ 15,683	$ (1,274)	$ 43,001
Denominator:
Weighted average common shares outstanding, basic	49,843,925			50,428,108			49,839,860	51,490,046
Weighted average effect of potentially dilutive common shares:
Weighted average common shares outstanding, diluted	49,843,925			50,441,572			49,839,860	51,500,657
Income (loss) per share
Basic (in dollars per share)	$ 0			$ 0.28			$ (0.03)	$ 0.84
Diluted (in dollars per share)	$ 0			$ 0.28			$ (0.03)	$ 0.83
Securities excluded from the computation of weighted average diluted shares outstanding as inclusion of such items would be anti-dilutive	531,104			174,514			530,034	213,749
Restricted Stock
Income (loss) per share
Securities excluded from the computation of weighted average diluted shares outstanding as inclusion of such items would be anti-dilutive	133,284						177,016	38,235
Stock Options
Income (loss) per share
Securities excluded from the computation of weighted average diluted shares outstanding as inclusion of such items would be anti-dilutive	397,820			174,514			353,018	175,514
Common stock | Restricted Stock
Weighted average effect of potentially dilutive common shares:
Incremental shares from share-based compensation				13,464				10,611

Fair Values of Financial Inst_3

Fair Values of Financial Instruments - Assets measured at fair value on a recurring basis (Details) - USD ($) $ in Thousands	Sep. 30, 2020	Dec. 31, 2019
Available for sale debt securities:
Available for sale debt securities, at fair value	$ 242,506	$ 147,289
Equity securities
Equity securities	5,132	5,009
U.S. Treasury securities
Available for sale debt securities:
Available for sale debt securities, at fair value		122,803
U.S. Treasury securities | Recurring
Available for sale debt securities:
Available for sale debt securities, at fair value		122,803
U.S. Treasury securities | Level 1 | Recurring
Available for sale debt securities:
Available for sale debt securities, at fair value		122,803
U.S. Treasury & Agency securities
Available for sale debt securities:
Available for sale debt securities, at fair value	95,375
U.S. Treasury & Agency securities | Recurring
Available for sale debt securities:
Available for sale debt securities, at fair value	95,375
U.S. Treasury & Agency securities | Level 1 | Recurring
Available for sale debt securities:
Available for sale debt securities, at fair value	45,371
U.S. Treasury & Agency securities | Level 2 | Recurring
Available for sale debt securities:
Available for sale debt securities, at fair value	50,004
Mortgage-backed securities
Available for sale debt securities:
Available for sale debt securities, at fair value	26,745	23,104
Mortgage-backed securities | Recurring
Available for sale debt securities:
Available for sale debt securities, at fair value	26,745	23,104
Mortgage-backed securities | Level 2 | Recurring
Available for sale debt securities:
Available for sale debt securities, at fair value	26,745	23,104
Collateralized mortgage obligations
Available for sale debt securities:
Available for sale debt securities, at fair value	120,202	1,183
Collateralized mortgage obligations | Recurring
Available for sale debt securities:
Available for sale debt securities, at fair value	120,202	1,183
Collateralized mortgage obligations | Level 2 | Recurring
Available for sale debt securities:
Available for sale debt securities, at fair value	120,202	1,183
Collateralized debt obligations
Available for sale debt securities:
Available for sale debt securities, at fair value	184	199
Collateralized debt obligations | Recurring
Available for sale debt securities:
Available for sale debt securities, at fair value	184	199
Collateralized debt obligations | Level 3 | Recurring
Available for sale debt securities:
Available for sale debt securities, at fair value	184	199
Equity securities | Recurring
Equity securities
Equity securities	5,132	5,009
Equity securities | Level 1 | Recurring
Equity securities
Equity securities	$ 5,132	$ 5,009

Fair Values of Financial Inst_4

Fair Values of Financial Instruments - Reconciliation and income statement classification using Level 3 inputs (Details) - Collateralized debt obligations - Recurring - Level 3 - USD ($) $ in Thousands	9 Months Ended		12 Months Ended
	Sep. 30, 2020	Sep. 30, 2019	Dec. 31, 2019
Reconciliation and income statement classification of gains and losses for all assets measured at fair value on a recurring basis using significant unobservable inputs (Level 3)
Balance of recurring Level 3 assets at beginning of period	$ 199	$ 297	$ 297
Included in other comprehensive income (loss)	(13)	(6)
Principal maturities/settlements	(2)	(91)
Balance of recurring Level 3 assets at end of period	184	200	199
Investment income
Unrealized losses on investments	30		$ 17
Interest income	$ 5	$ 10

Fair Values of Financial Inst_5

Fair Values of Financial Instruments - Assets Measured at Fair Value on a Non Recurring Basis and Fair Value of Financial Instruments (Details) $ in Thousands	Sep. 30, 2020USD ($)	Dec. 31, 2019USD ($)
Financial Assets
Interest-bearing time deposits with other banks	$ 7,988	$ 1,025
Nonrecurring | Mortgage servicing rights
Fair value of financial assets and liabilities
Assets measured at fair value on a non-recurring basis	6,181	7,949
Nonrecurring | Mortgage servicing rights | Level 3
Fair value of financial assets and liabilities
Assets measured at fair value on a non-recurring basis	6,181	7,949
Nonrecurring | Mortgage servicing rights | Level 3 | Discounted cash flow
Fair value of financial assets and liabilities
Assets measured at fair value on a non-recurring basis	$ 6,181	$ 7,949
Nonrecurring | Mortgage servicing rights | Maximum | Level 3 | Discounted cash flow | Discount rate
Fair value of financial assets and liabilities
Assets measured at fair value, measurement input	12	12
Nonrecurring | Mortgage servicing rights | Maximum | Level 3 | Discounted cash flow | Prepayment speed
Fair value of financial assets and liabilities
Assets measured at fair value, measurement input	38.5	47.1
Nonrecurring | Mortgage servicing rights | Maximum | Level 3 | Discounted cash flow | Default rate
Fair value of financial assets and liabilities
Assets measured at fair value, measurement input	0.3	0.3
Nonrecurring | Mortgage servicing rights | Minimum | Level 3 | Discounted cash flow | Discount rate
Fair value of financial assets and liabilities
Assets measured at fair value, measurement input	9.5	9.5
Nonrecurring | Mortgage servicing rights | Minimum | Level 3 | Discounted cash flow | Prepayment speed
Fair value of financial assets and liabilities
Assets measured at fair value, measurement input	8.7	7.2
Nonrecurring | Mortgage servicing rights | Minimum | Level 3 | Discounted cash flow | Default rate
Fair value of financial assets and liabilities
Assets measured at fair value, measurement input	0	0.1
Nonrecurring | Mortgage servicing rights | Weighted Average | Level 3 | Discounted cash flow | Discount rate
Fair value of financial assets and liabilities
Assets measured at fair value, measurement input	11.6	11.9
Nonrecurring | Mortgage servicing rights | Weighted Average | Level 3 | Discounted cash flow | Prepayment speed
Fair value of financial assets and liabilities
Assets measured at fair value, measurement input	22.3	21.3
Nonrecurring | Mortgage servicing rights | Weighted Average | Level 3 | Discounted cash flow | Default rate
Fair value of financial assets and liabilities
Assets measured at fair value, measurement input	0.2	0.2
Carrying value per balance sheet
Financial Assets
Cash and due from banks	$ 917,996	$ 77,819
Interest-bearing time deposits with other banks	7,988	1,025
Mortgage loans held for sale	3,643	1,337
Loans, net	2,627,324	2,891,530
Financial Liabilities
Time deposits	1,687,883	1,154,076
Federal Home Loan Bank borrowings	318,000	229,000
Subordinated notes, net	65,300	65,179
Estimated fair value
Financial Assets
Cash and due from banks	917,996	77,819
Interest-bearing time deposits with other banks	8,011	1,025
Mortgage loans held for sale	3,832	1,368
Loans, net	2,680,289	2,978,846
Financial Liabilities
Time deposits	1,699,441	1,161,490
Federal Home Loan Bank borrowings	331,691	227,333
Subordinated notes, net	66,312	65,650
Estimated fair value | Level 1
Financial Assets
Cash and due from banks	917,996	77,819
Interest-bearing time deposits with other banks		1,025
Estimated fair value | Level 2
Financial Assets
Interest-bearing time deposits with other banks	8,011
Mortgage loans held for sale	3,832	1,368
Financial Liabilities
Time deposits	1,699,441	1,161,490
Federal Home Loan Bank borrowings	331,691	227,333
Subordinated notes, net	66,312	65,650
Estimated fair value | Level 3
Financial Assets
Loans, net	$ 2,680,289	$ 2,978,846

Regulatory Capital Requiremen_3

Regulatory Capital Requirements - Capital adequacy requirements (Details)	Sep. 30, 2020
Regulatory Capital Requirements
Capital conservation buffer (as a percent)	2.50%

Regulatory Capital Requiremen_4

Regulatory Capital Requirements - Actual and minimum required capital amounts and ratios and Dividend Restrictions (Details) - USD ($) $ in Thousands	3 Months Ended	9 Months Ended
	Mar. 31, 2020	Sep. 30, 2020	Dec. 31, 2019
Regulatory Capital Requirements
Required Total capital adequacy with capital conservation buffer (as a percent)		10.50%
Required Tier 1 capital adequacy with capital conservation buffer (as a percent)		8.50%
Required Common Equity capital adequacy with capital conservation buffer (as a percent)		7.00%
Cash proceeds from capital contribution	$ 50,000
Total adjusted capital to risk-weighted assets, Amount
Actual		$ 420,023	$ 419,327
For Capital Adequacy Purposes		$ 151,551	$ 156,081
Total adjusted capital to risk-weighted assets, Ratio
Actual (as a percent)		22.17%	21.49%
For Capital Adequacy Purposes (as a percent)		8.00%	8.00%
Tier 1 (core) capital to risk-weighted assets, Amount
Actual		$ 330,739	$ 332,418
For Capital Adequacy Purposes		$ 113,663	$ 117,061
Tier 1 (core) capital to risk-weighted assets, Ratio
Actual (as a percent)		17.46%	17.04%
For Capital Adequacy Purposes (as a percent)		6.00%	6.00%
Common Equity Tier 1 (CET1), Amount
Actual		$ 330,739	$ 332,418
For Capital Adequacy Purposes		$ 85,247	$ 87,796
Common Equity Tier 1 (CET1), Ratio
Actual (as a percent)		17.46%	17.04%
For Capital Adequacy Purposes (as a percent)		4.50%	4.50%
Tier 1 (core) capital to adjusted tangible assets, Amount
Actual		$ 330,739	$ 332,418
For Capital Adequacy Purposes		$ 153,223	$ 131,471
Tier 1 (core) capital to adjusted tangible assets, Ratio
Actual (as a percent)		8.64%	10.11%
For Capital Adequacy Purposes (as a percent)		4.00%	4.00%
Dividend Restrictions
Minimum percentage of assets be maintained as per Qualified Thrift Lender ("QTL") test		65.00%
Bank
Regulatory Capital Requirements
Required Total capital adequacy with capital conservation buffer (as a percent)		10.50%
Required Tier 1 capital adequacy with capital conservation buffer (as a percent)		8.50%
Required Common Equity capital adequacy with capital conservation buffer (as a percent)		7.00%
Total adjusted capital to risk-weighted assets, Amount
Actual		$ 402,957	$ 346,985
For Capital Adequacy Purposes		151,324	155,809
To be Well Capitalized		$ 189,155	$ 194,761
Total adjusted capital to risk-weighted assets, Ratio
Actual (as a percent)		21.30%	17.82%
For Capital Adequacy Purposes (as a percent)		8.00%	8.00%
To be Well Capitalized (as a percent)		10.00%	10.00%
Tier 1 (core) capital to risk-weighted assets, Amount
Actual		$ 379,009	$ 325,255
For Capital Adequacy Purposes		113,493	116,857
To be Well Capitalized		$ 151,324	$ 155,809
Tier 1 (core) capital to risk-weighted assets, Ratio
Actual (as a percent)		20.03%	16.70%
For Capital Adequacy Purposes (as a percent)		6.00%	6.00%
To be Well Capitalized (as a percent)		8.00%	8.00%
Common Equity Tier 1 (CET1), Amount
Actual		$ 379,009	$ 325,255
For Capital Adequacy Purposes		85,120	87,643
To be Well Capitalized		$ 122,951	$ 126,595
Common Equity Tier 1 (CET1), Ratio
Actual (as a percent)		20.03%	16.70%
For Capital Adequacy Purposes (as a percent)		4.50%	4.50%
To be Well Capitalized (as a percent)		6.50%	6.50%
Tier 1 (core) capital to adjusted tangible assets, Amount
Actual		$ 379,009	$ 325,255
For Capital Adequacy Purposes		153,110	131,469
To be Well Capitalized		$ 191,387	$ 164,337
Tier 1 (core) capital to adjusted tangible assets, Ratio
Actual (as a percent)		9.90%	9.90%
For Capital Adequacy Purposes (as a percent)		4.00%	4.00%
To be Well Capitalized (as a percent)		5.00%	5.00%

Related Party Transactions (Det

Related Party Transactions (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2020	Sep. 30, 2019	Sep. 30, 2020	Sep. 30, 2019
Board of Directors | Charitable donation to foundation
Related party transactions
Amount of related party transaction, expense		$ 225	$ 375	$ 675
Controlling Shareholders
Related party transactions
Payments under leases	$ 57	46	177	137
Sublease income	69	70	207	207
Controlling Shareholders | Data processing and programming services provided
Related party transactions
Amount of related party transaction, revenue	$ 10	$ 29	$ 60	$ 81

Commitments and Contingencies -

Commitments and Contingencies - Unfunded Commitments to Extend Credit and Standby Letters of Credit (Details) $ in Thousands	Jul. 28, 2020item	Sep. 30, 2020USD ($)	Jul. 31, 2020USD ($)item	May 31, 2020USD ($)item	Sep. 30, 2020USD ($)	Sep. 30, 2019USD ($)	Sep. 30, 2020USD ($)	Sep. 30, 2019USD ($)	Dec. 31, 2019USD ($)
Commitments and Contingencies
Unpaid principal balance		$ 2,627,324			$ 2,627,324		$ 2,627,324		$ 2,891,530
Loss related to fair value discount recorded in other non-interest expense					1,612	$ 1,831	4,611	$ 5,656
Loss contingency from legal proceedings
Commitments and Contingencies
Accrued liability									25,000
Demand letter from purported stockholders
Commitments and Contingencies
Number of law firms | item	2
Threshold period for responding to Demand letter	90 days
Residential real estate
Commitments and Contingencies
Mortgage loan repurchase liability		7,197			7,197		7,197		7,823
Unpaid principal balance		$ 604,404			$ 604,404		604,404		759,568
Unfunded Commitments to Extend Credit | Residential real estate
Commitments and Contingencies
Outstanding commitments regarding fixed rate loans							18,769
Outstanding commitments with varying interest rates							$ 31,424
Maturity period for variable interest loans							30 years
Unfunded Commitments to Extend Credit | Residential real estate | Minimum
Commitments and Contingencies
Fixed interest rate (as a percent)		2.375%			2.375%		2.375%
Maturity period							15 years
Variable interest rate (as a percentage)		3.125%			3.125%		3.125%
Unfunded Commitments to Extend Credit | Residential real estate | Maximum
Commitments and Contingencies
Fixed interest rate (as a percent)		4.375%			4.375%		4.375%
Maturity period							30 years
Variable interest rate (as a percentage)		4.00%			4.00%		4.00%
Commitments to make loans
Commitments and Contingencies
Commitments to make loans		$ 50,193			$ 50,193		$ 50,193		76,927
Unused lines of credit
Commitments and Contingencies
Outstanding commitments regarding fixed rate loans							253
Outstanding commitments with varying interest rates							184,264
Unused lines of credit		$ 184,517			$ 184,517		$ 184,517		220,553
Unused lines of credit | Minimum
Commitments and Contingencies
Fixed interest rate (as a percent)		5.50%			5.50%		5.50%
Maturity period							3 months
Variable interest rate (as a percentage)		3.25%			3.25%		3.25%
Maturity period for variable interest loans							1 month
Unused lines of credit | Maximum
Commitments and Contingencies
Fixed interest rate (as a percent)		18.00%			18.00%		18.00%
Maturity period							7 years
Variable interest rate (as a percentage)		10.00%			10.00%		10.00%
Maturity period for variable interest loans							10 years
Unused lines of credit | Residential real estate
Commitments and Contingencies
Unused lines of credit		$ 19,372			$ 19,372		$ 19,372
Unused lines of credit | Construction
Commitments and Contingencies
Unused lines of credit		163,786			163,786		163,786
Unused lines of credit | Commercial lines of credit
Commitments and Contingencies
Unused lines of credit		1,143			1,143		1,143
Unused lines of credit | Other consumer
Commitments and Contingencies
Unused lines of credit		216			216		216
Standby letters of credit
Commitments and Contingencies
Unused lines of credit		24			24		24		24
Advantage Loan Program
Commitments and Contingencies
Unpaid principal balance		471,893			471,893		471,893		$ 670,243
Loss related to fair value discount recorded in other non-interest expense			$ 135	$ 136	$ 135		$ 271
Disposition of mortgage servicing rights		$ 158	$ 203	$ 428
Number of loan pools negotiated to be repurchased | item			3	2
Percentage of loans offered to each of investors to repurchase		100.00%			100.00%		100.00%

Commitments and Contingencies_2

Commitments and Contingencies - Advantage Loan Program Loans Sold (Details) $ in Thousands	1 Months Ended			3 Months Ended		9 Months Ended
	Sep. 30, 2020USD ($)	Jul. 31, 2020USD ($)item	May 31, 2020USD ($)item	Sep. 30, 2020USD ($)	Sep. 30, 2019USD ($)	Sep. 30, 2020USD ($)	Sep. 30, 2019USD ($)	Dec. 31, 2019USD ($)
Commitments and Contingencies
Unpaid principal balance	$ 2,627,324			$ 2,627,324		$ 2,627,324		$ 2,891,530
Loss related to fair value discount recorded in other non-interest expense				1,612	$ 1,831	4,611	$ 5,656
Advantage Loan Program
Commitments and Contingencies
Number of third party investors accepted to repurchase | item		3
Number of loan pools negotiated to be repurchased | item		3	2
Unpaid principal balance	471,893			471,893		471,893		$ 670,243
Outstanding principal balance of loans repurchased	11,683	$ 19,251	$ 38,704	30,934		69,638
Loss related to fair value discount recorded in other non-interest expense		135	136	$ 135		$ 271
Loss charged against mortgage repurchase liability	218	433
Disposition of mortgage servicing rights	$ 158	$ 203	$ 428

Subsequent Events (Details)

Subsequent Events (Details) - Quantum Capital Management - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2020	Sep. 30, 2019	Sep. 30, 2020	Sep. 30, 2019
Sale of business
Revenue	$ 310	$ 477	$ 878	$ 1,242
Net income (loss)	$ (69)	$ (504)	$ (455)	$ (1,943)