Loans Receivable - Past Due Loans (Details) - USD ($) $ in Thousands | Sep. 30, 2017 | Dec. 31, 2016 |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | $ 6,330 | $ 6,239 |
Recorded Investment, Loans Not Past Due | 1,331,317 | 1,308,023 |
Recorded investment, total | 1,337,647 | 1,314,262 |
Commercial Leases Investment Rated [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 2,225 | 51 |
Recorded Investment, Loans Not Past Due | 230,009 | 273,405 |
Recorded investment, total | 232,234 | 273,456 |
Commercial Loans Other [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Recorded Investment, Loans Not Past Due | 102,698 | 84,988 |
Recorded investment, total | 102,698 | 84,988 |
Consumer Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Recorded Investment, Loans Not Past Due | 1,754 | 2,263 |
Recorded investment, total | 1,754 | 2,263 |
Commercial Loans Health Care [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Loans Not Past Due | 72,685 | 41,086 |
Recorded investment, total | 72,685 | 41,086 |
Commercial Loans Municipal [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 644 | 0 |
Recorded Investment, Loans Not Past Due | 33,787 | 31,847 |
Recorded investment, total | 34,431 | 31,847 |
Commercial loans - unsecured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Commercial loans - Secured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Recorded Investment, Loans Not Past Due | 40,315 | 26,480 |
Recorded investment, total | 40,315 | 26,480 |
Land Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Recorded Investment, Loans Not Past Due | 281 | 349 |
Recorded investment, total | 281 | 349 |
Construction Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Recorded Investment, Loans Not Past Due | 2,548 | 950 |
Recorded investment, total | 2,548 | 950 |
Commercial Real Estate [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 260 |
Recorded Investment, Loans Not Past Due | 174,724 | 178,644 |
Recorded investment, total | 174,724 | 178,904 |
Wholesale Commercial Lending [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Recorded Investment, Loans Not Past Due | 281,887 | 243,944 |
Recorded investment, total | 281,887 | 243,944 |
Multi Family Mortgage Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 371 | 1,228 |
Recorded Investment, Loans Not Past Due | 288,508 | 294,223 |
Recorded investment, total | 288,879 | 295,451 |
One To Four Family Residential Real Estate Loans Non Owner Occupied [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 592 | 1,146 |
Recorded Investment, Loans Not Past Due | 22,321 | 37,179 |
Recorded investment, total | 22,913 | 38,325 |
One to Four Family Residential Real Estate Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 2,498 | 3,554 |
Recorded Investment, Loans Not Past Due | 79,800 | 92,665 |
Recorded investment, total | 82,298 | 96,219 |
Financing Receivables, 30 to 59 Days Past Due [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 381 | 2,304 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial Leases Investment Rated [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 51 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial Loans Other [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Consumer Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial Loans Municipal [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 275 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial loans - unsecured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial loans - Secured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Land Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Construction Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial Real Estate [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Wholesale Commercial Lending [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 30 to 59 Days Past Due [Member] | Multi Family Mortgage Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 605 |
Financing Receivables, 30 to 59 Days Past Due [Member] | One To Four Family Residential Real Estate Loans Non Owner Occupied [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 12 | 664 |
Financing Receivables, 30 to 59 Days Past Due [Member] | One to Four Family Residential Real Estate Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 94 | 984 |
Financing Receivables, 60 to 89 Days Past Due [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 3,346 | 888 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial Leases Investment Rated [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial Loans Other [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Consumer Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial Loans Health Care [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 2,225 | |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial Loans Municipal [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 369 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial loans - unsecured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial loans - Secured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Land Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Construction Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial Real Estate [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Wholesale Commercial Lending [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, 60 to 89 Days Past Due [Member] | Multi Family Mortgage Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 439 |
Financing Receivables, 60 to 89 Days Past Due [Member] | One To Four Family Residential Real Estate Loans Non Owner Occupied [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 3 | 114 |
Financing Receivables, 60 to 89 Days Past Due [Member] | One to Four Family Residential Real Estate Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 749 | 335 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial Leases Investment Rated [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 2,603 | 3,047 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial Loans Other [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Consumer Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial Loans Health Care [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial Loans Municipal [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial loans - unsecured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial loans - Secured [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Land Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Construction Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial Real Estate [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 260 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Wholesale Commercial Lending [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 0 | 0 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Multi Family Mortgage Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 371 | 184 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | One To Four Family Residential Real Estate Loans Non Owner Occupied [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | 577 | 368 |
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | One to Four Family Residential Real Estate Loans [Member] | | |
Financing Receivable, Recorded Investment, Past Due [Line Items] | | |
Recorded Investment, Total Past Due | $ 1,655 | $ 2,235 |