EXHIBIT 23 CONSENT OF INDEPENDENT AUDITORS We consent to the incorporation by reference in this Annual Report on Form 10-K of First Keystone Corporation of our report dated January 21, 2004, included in the 2003 Annual Report to Stockholders of First Keystone Corporation. /s/ J. H. Williams & Co., LLP J. H. Williams & Co., LLP Certified Public Accountants March 12, 2004 Kingston, Pennsylvania 25