Exhibit 32.1

      Certification of Chief Executive Officer and Chief Financial Officer
            Pursuant to Section 906 of the Sarbanes-Oxley Act of 2002

George Strayton, Chief Executive Officer and Paul A. Maisch, Chief Financial
Officer of Provident Bancorp, Inc. (the "Company") each certify in his capacity
as an officer of the Company that he has reviewed the quarterly report on Form
10-Q for the quarter ended December 31, 2003 and that to the best of his
knowledge:

            (1)   the report fully complies with the requirements of Sections
                  13(a) or 15(d) of the Securities Exchange Act of 1934; and

            (2)   the information contained in the report fairly presents, in
                  all material respects, the financial condition and results of
                  operations of the Company.

A signed original of this written statement required by Section 906 has been
provided to Provident Bancorp, Inc. and will be retained by Provident Bancorp,
Inc. and furnished to the Securities and Exchange Commission or its staff upon
request.


                                                 \s\ George Strayton
                                                 -------------------
         Date: February 12 , 2004                George Strayton
                                                 Chief Executive Officer


                                                 \s\ Paul A. Maisch
                                                 -------------------
         Date: February 12 , 2004                Paul A. Maisch
                                                 Chief Financial Officer


                                       38