Loans Receivable - Past Due Loans (Details) - USD ($) $ in Thousands | Sep. 30, 2019 | Dec. 31, 2018 |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | $ 3,897 | $ 4,931 |
Recorded Investment, Loans Not Past Due | 1,211,320 | 1,321,501 |
Recorded investment, total | 1,215,217 | 1,326,432 |
Commercial Leases Investment Rated [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 211 | 505 |
Recorded Investment, Loans Not Past Due | 133,697 | 166,713 |
Recorded investment, total | 133,908 | 167,218 |
Commercial Loans Other [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 1,710 | 0 |
Recorded Investment, Loans Not Past Due | 141,877 | 133,958 |
Recorded investment, total | 143,587 | 133,958 |
Consumer Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 9 | 44 |
Recorded Investment, Loans Not Past Due | 2,060 | 1,508 |
Recorded investment, total | 2,069 | 1,552 |
Commercial Loans Health Care [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Loans Not Past Due | 75,454 | 85,418 |
Recorded investment, total | 75,454 | 85,418 |
Commercial Loans Municipal [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Recorded Investment, Loans Not Past Due | 60,664 | 62,719 |
Recorded investment, total | 60,664 | 62,719 |
Commercial loans - unsecured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Commercial loans - Secured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Recorded Investment, Loans Not Past Due | 28,193 | 39,712 |
Recorded investment, total | 28,193 | 39,712 |
Land Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Recorded Investment, Loans Not Past Due | 80 | 169 |
Recorded investment, total | 80 | 169 |
Commercial Real Estate [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 282 | 270 |
Recorded Investment, Loans Not Past Due | 138,884 | 149,271 |
Recorded investment, total | 139,166 | 149,541 |
Wholesale Commercial Lending [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Recorded Investment, Loans Not Past Due | 314,698 | 340,470 |
Recorded investment, total | 314,698 | 340,470 |
Multi Family Mortgage Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 458 |
Recorded Investment, Loans Not Past Due | 256,662 | 275,283 |
Recorded investment, total | 256,662 | 275,741 |
One To Four Family Residential Real Estate Loans Non Owner Occupied [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 410 | 475 |
Recorded Investment, Loans Not Past Due | 11,062 | 12,460 |
Recorded investment, total | 11,472 | 12,935 |
One to Four Family Residential Real Estate Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 1,275 | 3,179 |
Recorded Investment, Loans Not Past Due | 47,989 | 53,820 |
Recorded investment, total | 49,264 | 56,999 |
Financing Receivables, 30 to 59 Days Past Due [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 1,920 | 2,770 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial Leases Investment Rated [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 197 | 505 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial Loans Other [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 1,710 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Consumer Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 6 | 40 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial Loans Municipal [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial loans - unsecured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial loans - Secured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Land Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial Real Estate [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Wholesale Commercial Lending [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Multi Family Mortgage Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 458 |
Financing Receivables, 30 to 59 Days Past Due [Member] | One To Four Family Residential Real Estate Loans Non Owner Occupied [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 4 | 387 |
Financing Receivables, 30 to 59 Days Past Due [Member] | One to Four Family Residential Real Estate Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 3 | 1,380 |
Financing Receivables, 60 to 89 Days Past Due [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 541 | 921 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial Leases Investment Rated [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial Loans Other [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Consumer Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 3 | 4 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial Loans Health Care [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 14 | |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial Loans Municipal [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial loans - unsecured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial loans - Secured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Land Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial Real Estate [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 270 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Wholesale Commercial Lending [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Multi Family Mortgage Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | One To Four Family Residential Real Estate Loans Non Owner Occupied [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 269 | 10 |
Financing Receivables, 60 to 89 Days Past Due [Member] | One to Four Family Residential Real Estate Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 255 | 637 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial Leases Investment Rated [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 1,436 | 1,240 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial Loans Other [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Consumer Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial Loans Health Care [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial Loans Municipal [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial loans - unsecured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial loans - Secured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Land Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial Real Estate [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 282 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Wholesale Commercial Lending [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Multi Family Mortgage Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | One To Four Family Residential Real Estate Loans Non Owner Occupied [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 137 | 78 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | One to Four Family Residential Real Estate Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | $ 1,017 | $ 1,162 |