Exhibit 32

                Certification pursuant to 18 U.S.C. Section 1350,
                                  as amended by
                  Section 906 of the Sarbanes-Oxley Act of 2002

George  Strayton,  President and Chief  Executive  Officer,  and Paul A. Maisch,
Senior Vice President and Chief  Financial  Officer of Provident  Bancorp,  Inc.
(the "Company"), each certify in his capacity as an officer of Provident Bancorp
that he has reviewed the Annual Report of Provident Bancorp on Form 10-K for the
year ended September 30, 2004 and that to the best of his knowledge:

      1.    the report fully complies with the  requirements of Section 13(a) of
            the Securities Exchange Act of 1934; and

      2.    the  information  contained in the report  fairly  presents,  in all
            material respects, the financial condition and results of operations
            of Provident Bancorp.

The purpose of this  statement  is solely to comply  with Title 18,  Chapter 63,
Section  1350 of the United  States  Code,  as  amended  by  Section  906 of the
Sarbanes-Oxley Act of 2002.

A signed  original of this  written  statement  required by Section 906 has been
provided to Provident  Bancorp,  Inc. and will be retained by Provident Bancorp,
Inc. and furnished to the Securities  and Exchange  Commission or its staff upon
request.


      December 13, 2004                 /s/ George Strayton
      -----------------                 ----------------------------------------
      Date                              George Strayton
                                        President and Chief Executive Officer


      December 13, 2004                 /s/ Paul A. Maisch
      -----------------                 ----------------------------------------
      Date                              Paul A. Maisch
                                        Senior Vice President and
                                        Chief Financial Officer


                                       111