Loans and Credit Quality - Impaired Loans (Details) - USD ($) $ in Thousands | 3 Months Ended | 6 Months Ended | |
Jun. 30, 2016 | Jun. 30, 2015 | Jun. 30, 2016 | Jun. 30, 2015 | Dec. 31, 2015 |
Financing Receivable, Impaired [Line Items] | | | | | |
Impaired loan, no related allowance, recorded investment | $ 40,001 | | $ 40,001 | | $ 33,579 |
Impaired loan, no related allowance, unpaid principal balance | 40,681 | | 40,681 | | 33,992 |
Impaired loan, related allowance, recorded investment | 4,372 | | 4,372 | | 1,061 |
Impaired loan, related allowance, unpaid principal balance | 4,372 | | 4,372 | | 1,061 |
Related allowance | 227 | | 227 | | 344 |
Recorded investment | 44,373 | | 44,373 | | 34,640 |
Unpaid principal balance | 45,053 | | 45,053 | | 35,053 |
Impaired loan, no related allowance, average recorded investment | 40,306 | $ 24,202 | 40,983 | $ 17,828 | |
Impaired loan, no related allowance, interest income on accrual method | 454 | 181 | 941 | 336 | |
Impaired loan, related allowance, average recorded investment | 4,264 | 2,414 | 2,429 | 2,471 | |
Impaired loan, related allowance, interest income on accrual method | 0 | 0 | 0 | 0 | |
Impaired loan, average recorded investment | 44,570 | 26,616 | 43,412 | 20,299 | |
Impaired loan, interest income on accrual method | 454 | 181 | 941 | 336 | |
Commercial | Asset Quality Rating - Special Mention | | | | | |
Financing Receivable, Impaired [Line Items] | | | | | |
Impaired loan, no related allowance, recorded investment | 151 | | 151 | | 157 |
Impaired loan, no related allowance, unpaid principal balance | 151 | | 151 | | 157 |
Related allowance | 0 | | 0 | | 0 |
Recorded investment | 151 | | 151 | | 157 |
Unpaid principal balance | 151 | | 151 | | 157 |
Impaired loan, no related allowance, average recorded investment | 152 | 164 | 154 | 166 | |
Impaired loan, no related allowance, interest income on accrual method | 3 | 3 | 6 | 7 | |
Impaired loan, average recorded investment | 152 | 164 | 154 | 166 | |
Impaired loan, interest income on accrual method | 3 | 3 | 6 | 7 | |
Commercial | Asset Quality Rating - Substandard | | | | | |
Financing Receivable, Impaired [Line Items] | | | | | |
Impaired loan, no related allowance, recorded investment | 19,427 | | 19,427 | | 14,030 |
Impaired loan, no related allowance, unpaid principal balance | 20,107 | | 20,107 | | 14,443 |
Impaired loan, related allowance, recorded investment | | | | | 1,061 |
Impaired loan, related allowance, unpaid principal balance | | | | | 1,061 |
Related allowance | 0 | | 0 | | 344 |
Recorded investment | 19,427 | | 19,427 | | 15,091 |
Unpaid principal balance | 20,107 | | 20,107 | | 15,504 |
Impaired loan, no related allowance, average recorded investment | 19,699 | 12,315 | 18,143 | 7,703 | |
Impaired loan, no related allowance, interest income on accrual method | 176 | 41 | 374 | 70 | |
Impaired loan, related allowance, average recorded investment | 0 | 2,414 | 297 | 2,330 | |
Impaired loan, related allowance, interest income on accrual method | 0 | 0 | 0 | 0 | |
Impaired loan, average recorded investment | 19,699 | 14,729 | 18,440 | 10,033 | |
Impaired loan, interest income on accrual method | 176 | 41 | 374 | 70 | |
Real estate construction one-to-four family | Asset Quality Rating - Substandard | | | | | |
Financing Receivable, Impaired [Line Items] | | | | | |
Impaired loan, related allowance, recorded investment | 3,972 | | 3,972 | | |
Impaired loan, related allowance, unpaid principal balance | 3,972 | | 3,972 | | |
Related allowance | 204 | | 204 | | |
Recorded investment | 3,972 | | 3,972 | | |
Unpaid principal balance | 3,972 | | 3,972 | | |
Impaired loan, no related allowance, average recorded investment | | | 1,986 | 0 | |
Impaired loan, no related allowance, interest income on accrual method | | | 0 | 0 | |
Impaired loan, related allowance, average recorded investment | 3,972 | 0 | 1,986 | 0 | |
Impaired loan, related allowance, interest income on accrual method | 0 | 0 | 0 | 0 | |
Impaired loan, average recorded investment | 3,972 | 0 | 3,972 | 0 | |
Impaired loan, interest income on accrual method | 0 | 0 | 0 | 0 | |
Real estate construction other | Asset Quality Rating - Pass | | | | | |
Financing Receivable, Impaired [Line Items] | | | | | |
Impaired loan, no related allowance, average recorded investment | 0 | 743 | 0 | 753 | |
Impaired loan, no related allowance, interest income on accrual method | 0 | 30 | 0 | 59 | |
Impaired loan, average recorded investment | 0 | 743 | 0 | 753 | |
Impaired loan, interest income on accrual method | 0 | 30 | 0 | 59 | |
Real estate construction other | Asset Quality Rating - Substandard | | | | | |
Financing Receivable, Impaired [Line Items] | | | | | |
Impaired loan, no related allowance, recorded investment | 1,912 | | 1,912 | | |
Impaired loan, no related allowance, unpaid principal balance | 1,912 | | 1,912 | | |
Related allowance | 0 | | 0 | | |
Recorded investment | 1,912 | | 1,912 | | |
Unpaid principal balance | 1,912 | | 1,912 | | |
Impaired loan, no related allowance, average recorded investment | 1,912 | 0 | 1,912 | 0 | |
Impaired loan, no related allowance, interest income on accrual method | 0 | 0 | 0 | 0 | |
Impaired loan, average recorded investment | 1,912 | 0 | 1,912 | 0 | |
Impaired loan, interest income on accrual method | 0 | 0 | 0 | 0 | |
Real estate term owner occupied | Asset Quality Rating - Pass | | | | | |
Financing Receivable, Impaired [Line Items] | | | | | |
Impaired loan, no related allowance, recorded investment | 257 | | 257 | | 753 |
Impaired loan, no related allowance, unpaid principal balance | 257 | | 257 | | 753 |
Related allowance | 0 | | 0 | | 0 |
Recorded investment | 257 | | 257 | | 753 |
Unpaid principal balance | 257 | | 257 | | 753 |
Impaired loan, no related allowance, average recorded investment | 258 | 766 | 504 | 634 | |
Impaired loan, no related allowance, interest income on accrual method | 5 | 17 | 19 | 28 | |
Impaired loan, average recorded investment | 258 | 766 | 504 | 634 | |
Impaired loan, interest income on accrual method | 5 | 17 | 19 | 28 | |
Real estate term owner occupied | Asset Quality Rating - Special Mention | | | | | |
Financing Receivable, Impaired [Line Items] | | | | | |
Impaired loan, no related allowance, average recorded investment | | | 0 | 135 | |
Impaired loan, no related allowance, interest income on accrual method | | | 0 | 5 | |
Impaired loan, average recorded investment | | | 0 | 135 | |
Impaired loan, interest income on accrual method | | | 0 | 5 | |
Real estate term owner occupied | Asset Quality Rating - Substandard | | | | | |
Financing Receivable, Impaired [Line Items] | | | | | |
Impaired loan, no related allowance, recorded investment | 16,259 | | 16,259 | | 16,476 |
Impaired loan, no related allowance, unpaid principal balance | 16,259 | | 16,259 | | 16,476 |
Related allowance | 0 | | 0 | | 0 |
Recorded investment | 16,259 | | 16,259 | | 16,476 |
Unpaid principal balance | 16,259 | | 16,259 | | 16,476 |
Impaired loan, no related allowance, average recorded investment | 16,283 | 5,269 | 16,342 | 2,967 | |
Impaired loan, no related allowance, interest income on accrual method | 232 | 19 | 467 | 28 | |
Impaired loan, average recorded investment | 16,283 | 5,269 | 16,342 | 2,967 | |
Impaired loan, interest income on accrual method | 232 | 19 | 467 | 28 | |
Real estate term non-owner occupied | Asset Quality Rating - Pass | | | | | |
Financing Receivable, Impaired [Line Items] | | | | | |
Impaired loan, no related allowance, recorded investment | 457 | | 457 | | 473 |
Impaired loan, no related allowance, unpaid principal balance | 457 | | 457 | | 473 |
Related allowance | 0 | | 0 | | 0 |
Recorded investment | 457 | | 457 | | 473 |
Unpaid principal balance | 457 | | 457 | | 473 |
Impaired loan, no related allowance, average recorded investment | 462 | 541 | 466 | 544 | |
Impaired loan, no related allowance, interest income on accrual method | 18 | 19 | 37 | 38 | |
Impaired loan, average recorded investment | 462 | 541 | 466 | 544 | |
Impaired loan, interest income on accrual method | 18 | 19 | 37 | 38 | |
Real estate term non-owner occupied | Asset Quality Rating - Special Mention | | | | | |
Financing Receivable, Impaired [Line Items] | | | | | |
Impaired loan, no related allowance, average recorded investment | 0 | 2,079 | 0 | 2,127 | |
Impaired loan, no related allowance, interest income on accrual method | 0 | 44 | 0 | 88 | |
Impaired loan, average recorded investment | 0 | 2,079 | 0 | 2,127 | |
Impaired loan, interest income on accrual method | 0 | 44 | 0 | 88 | |
Real estate term non-owner occupied | Asset Quality Rating - Substandard | | | | | |
Financing Receivable, Impaired [Line Items] | | | | | |
Impaired loan, no related allowance, recorded investment | 216 | | 216 | | 352 |
Impaired loan, no related allowance, unpaid principal balance | 216 | | 216 | | 352 |
Related allowance | 0 | | 0 | | 0 |
Recorded investment | 216 | | 216 | | 352 |
Unpaid principal balance | 216 | | 216 | | 352 |
Impaired loan, no related allowance, average recorded investment | 222 | 1,652 | 230 | 2,009 | |
Impaired loan, no related allowance, interest income on accrual method | 0 | 0 | 0 | 0 | |
Impaired loan, average recorded investment | 222 | 1,652 | 230 | 2,009 | |
Impaired loan, interest income on accrual method | 0 | 0 | 0 | 0 | |
Real estate term other | Asset Quality Rating - Pass | | | | | |
Financing Receivable, Impaired [Line Items] | | | | | |
Impaired loan, no related allowance, recorded investment | 662 | | 662 | | 699 |
Impaired loan, no related allowance, unpaid principal balance | 662 | | 662 | | 699 |
Related allowance | 0 | | 0 | | 0 |
Recorded investment | 662 | | 662 | | 699 |
Unpaid principal balance | 662 | | 662 | | 699 |
Impaired loan, no related allowance, average recorded investment | 674 | 0 | 608 | 0 | |
Impaired loan, no related allowance, interest income on accrual method | 12 | 0 | 24 | 0 | |
Impaired loan, average recorded investment | 674 | 0 | 608 | 0 | |
Impaired loan, interest income on accrual method | 12 | 0 | 24 | 0 | |
Real estate term other | Asset Quality Rating - Special Mention | | | | | |
Financing Receivable, Impaired [Line Items] | | | | | |
Impaired loan, no related allowance, recorded investment | 77 | | 77 | | 91 |
Impaired loan, no related allowance, unpaid principal balance | 77 | | 77 | | 91 |
Related allowance | 0 | | 0 | | 0 |
Recorded investment | 77 | | 77 | | 91 |
Unpaid principal balance | 77 | | 77 | | 91 |
Impaired loan, no related allowance, average recorded investment | 83 | 0 | 87 | 0 | |
Impaired loan, no related allowance, interest income on accrual method | 2 | 0 | 4 | 0 | |
Impaired loan, average recorded investment | 83 | 0 | 87 | 0 | |
Impaired loan, interest income on accrual method | 2 | 0 | 4 | 0 | |
Real estate term other | Asset Quality Rating - Substandard | | | | | |
Financing Receivable, Impaired [Line Items] | | | | | |
Impaired loan, no related allowance, average recorded investment | 0 | 149 | 0 | 149 | |
Impaired loan, no related allowance, interest income on accrual method | 0 | 3 | 0 | 7 | |
Impaired loan, related allowance, average recorded investment | | | 0 | 141 | |
Impaired loan, related allowance, interest income on accrual method | | | 0 | 0 | |
Impaired loan, average recorded investment | 0 | 149 | 0 | 290 | |
Impaired loan, interest income on accrual method | 0 | 3 | 0 | 7 | |
Consumer secured by 1st deeds of trust | Asset Quality Rating - Pass | | | | | |
Financing Receivable, Impaired [Line Items] | | | | | |
Impaired loan, no related allowance, recorded investment | 74 | | 74 | | 76 |
Impaired loan, no related allowance, unpaid principal balance | 74 | | 74 | | 76 |
Related allowance | 0 | | 0 | | 0 |
Recorded investment | 74 | | 74 | | 76 |
Unpaid principal balance | 74 | | 74 | | 76 |
Impaired loan, no related allowance, average recorded investment | 75 | 80 | 75 | 81 | |
Impaired loan, no related allowance, interest income on accrual method | 1 | 1 | 2 | 2 | |
Impaired loan, average recorded investment | 75 | 80 | 75 | 81 | |
Impaired loan, interest income on accrual method | 1 | 1 | 2 | 2 | |
Consumer secured by 1st deeds of trust | Asset Quality Rating - Substandard | | | | | |
Financing Receivable, Impaired [Line Items] | | | | | |
Impaired loan, no related allowance, recorded investment | 509 | | 509 | | 472 |
Impaired loan, no related allowance, unpaid principal balance | 509 | | 509 | | 472 |
Impaired loan, related allowance, recorded investment | 400 | | 400 | | |
Impaired loan, related allowance, unpaid principal balance | 400 | | 400 | | |
Related allowance | 23 | | 23 | | 0 |
Recorded investment | 909 | | 909 | | 472 |
Unpaid principal balance | 909 | | 909 | | $ 472 |
Impaired loan, no related allowance, average recorded investment | 486 | 444 | 476 | 560 | |
Impaired loan, no related allowance, interest income on accrual method | 5 | 4 | 8 | 4 | |
Impaired loan, related allowance, average recorded investment | 292 | 0 | 146 | 0 | |
Impaired loan, related allowance, interest income on accrual method | 0 | 0 | 0 | 0 | |
Impaired loan, average recorded investment | 778 | 444 | 622 | 560 | |
Impaired loan, interest income on accrual method | $ 5 | $ 4 | $ 8 | $ 4 | |