Loans Receivable - Past Due Loans (Details) - USD ($) $ in Thousands | Mar. 31, 2020 | Dec. 31, 2019 |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | $ 12,465 | $ 5,103 |
Recorded Investment, Loans Not Past Due | 1,142,427 | 1,169,625 |
Recorded investment, total | 1,154,892 | 1,174,728 |
Commercial Leases Investment Rated [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 5,109 | 873 |
Recorded Investment, Loans Not Past Due | 119,342 | 132,966 |
Recorded investment, total | 124,451 | 133,839 |
Commercial Loans Other [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 4,536 | 679 |
Recorded Investment, Loans Not Past Due | 137,076 | 138,111 |
Recorded investment, total | 141,612 | 138,790 |
Consumer Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 14 | 61 |
Recorded Investment, Loans Not Past Due | 2,064 | 2,150 |
Recorded investment, total | 2,078 | 2,211 |
Commercial Loans Health Care [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Loans Not Past Due | 54,806 | 70,430 |
Recorded investment, total | 54,806 | 70,430 |
Commercial Loans Municipal [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Recorded Investment, Loans Not Past Due | 79,539 | 50,431 |
Recorded investment, total | 79,539 | 50,431 |
Commercial loans - unsecured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Commercial loans - Secured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Recorded Investment, Loans Not Past Due | 23,704 | 24,853 |
Recorded investment, total | 23,704 | 24,853 |
Commercial Real Estate [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 288 | 288 |
Recorded Investment, Loans Not Past Due | 133,144 | 134,386 |
Recorded investment, total | 133,432 | 134,674 |
Wholesale Commercial Lending [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Recorded Investment, Loans Not Past Due | 307,759 | 315,787 |
Recorded investment, total | 307,759 | 315,787 |
Multi Family Mortgage Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 1,258 | 1,283 |
Recorded Investment, Loans Not Past Due | 233,404 | 246,680 |
Recorded investment, total | 234,662 | 247,963 |
One To Four Family Residential Real Estate Loans Non Owner Occupied [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 131 | 295 |
Recorded Investment, Loans Not Past Due | 9,938 | 10,466 |
Recorded investment, total | 10,069 | 10,761 |
One to Four Family Residential Real Estate Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 1,129 | 1,624 |
Recorded Investment, Loans Not Past Due | 41,651 | 43,365 |
Recorded investment, total | 42,780 | 44,989 |
Financing Receivables, 30 to 59 Days Past Due [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 11,255 | 3,431 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial Leases Investment Rated [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 5,109 | 826 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial Loans Other [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 4,093 | 543 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Consumer Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 7 | 24 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial Loans Municipal [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial loans - unsecured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial loans - Secured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial Real Estate [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Wholesale Commercial Lending [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Multi Family Mortgage Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 1,258 | 981 |
Financing Receivables, 30 to 59 Days Past Due [Member] | One To Four Family Residential Real Estate Loans Non Owner Occupied [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 131 | 280 |
Financing Receivables, 30 to 59 Days Past Due [Member] | One to Four Family Residential Real Estate Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 657 | 777 |
Financing Receivables, 60 to 89 Days Past Due [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 450 | 830 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial Leases Investment Rated [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial Loans Other [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 443 | 136 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Consumer Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 7 | 37 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial Loans Health Care [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial Loans Municipal [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial loans - unsecured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial loans - Secured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial Real Estate [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Wholesale Commercial Lending [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Multi Family Mortgage Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 302 |
Financing Receivables, 60 to 89 Days Past Due [Member] | One To Four Family Residential Real Estate Loans Non Owner Occupied [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 15 |
Financing Receivables, 60 to 89 Days Past Due [Member] | One to Four Family Residential Real Estate Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 340 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial Leases Investment Rated [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 760 | 842 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial Loans Other [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Consumer Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial Loans Health Care [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 47 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial Loans Municipal [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial loans - unsecured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial loans - Secured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial Real Estate [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 288 | 288 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Wholesale Commercial Lending [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Multi Family Mortgage Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | One To Four Family Residential Real Estate Loans Non Owner Occupied [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | One to Four Family Residential Real Estate Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | $ 472 | $ 507 |